Google Fellowship

Session 1 โ€” Grounded Reasoning: Assessment in the Age of AI โœ…

July 15, 2026 ยท COMPLETED

๐ŸŽฏ My Challenge Statement (Final)

Sharper โ€” specific, measurable outcomes Bolder โ€” solves at scale Integrated โ€” names specific Google tools
"How might we use Google Stitch, Nano Banana (Gemini 3.1 Flash Image), Gemini Gems, and NotebookLM to build a Cognitive-Process Assessment framework that captures the domain expertise UX/UI designers apply when directing, writing, and refining AI-assisted design, making the invisible 'intellectual fingerprint' of expert design judgment verifiable, assessable, and protectable as student IP, scaled as the global standard for design higher education by 2027?"
Theme

Translate your challenge into a concrete solution. What does CPA actually look like in practice? Google's own session theme turned out to be the same problem CPA solves โ€” see the recap below.

What was prepared

  • Complete Digital Workbook from Kick-off
  • Post both Community Hub items (Challenges thread + Prep thread)
  • Build out the CPA framework with rubrics and evidence types
  • Prepare 90-second pitch

Session Recap: Grounded Reasoning & REVEAL

Grounded Reasoning = factual grounding + logical reasoning together. Google framed the "Assessment Crisis" as the direct parallel to AI hallucinations: outputs that are plausible but built on fabricated knowledge, from students cognitive-offloading โ€” essentially Google's own words for the CPA problem statement.

REVEAL (Google Research/DeepMind) is a public benchmark dataset that grades an AI's chain of thought sentence by sentence rather than judging only the final answer, via a Fact Check (Fully Supported / Partially Supported / Contradictory-Hallucination / Unsupported) and a Logic Check (does the conclusion validly follow, even assuming prior steps are true). It's a research dataset, not a plug-and-play classroom tool, but its labeling schema is directly citable prior art for CPA.

Reframe worth adopting: moving from "AI Policing" to "Thinking Design" โ€” make thinking visible, build AI-resistant assessment, teach AI with intention not deference, balance efficiency with cognitive resilience.

Two breakout questions Google itself posed, which CPA directly answers: "How do students document their intellectual history?" and "Is asking to see prompt history a creative infringement?"

Citation: Jacovi, A., Bitton, Y., Bohnet, B., Herzig, J., Honovich, O., Tseng, M., Collins, M., Aharoni, R., & Geva, M. (2024). A Chain-of-Thought Is as Strong as Its Weakest Link: A Benchmark for Verifiers of Reasoning Chains. Proceedings of ACL 2024. arXiv:2402.00559. doi.org/10.48550/arXiv.2402.00559 ยท Dataset: huggingface.co/datasets/google/reveal

CPA Framework: What Gets Assessed

DimensionWhat it measuresEvidenceTools
Prompt ArchitectureStrategic intent, vocabulary depth, and contextual framing behind AI instructions.Raw prompt logs, systematic variable testing, and multi-turn iteration history.Google Stitch / Gemini
Orchestration LogicHow the student chains multiple AI tools together into an end-to-end design workflow.Workflow maps, tool-handoff documentation, and architectural decision rationales.Gemini Notebook
Strategic & Content DevelopmentThe student's critical thinking in making and justifying strategic content decisions โ€” feature scope, content priorities, and value proposition โ€” grounded in research findings rather than default or generic choices.Feature-scope prioritization frameworks, content/IA decision logs, and value-proposition rationale documents.Gemini Notebook / Gemini
Critical CurationThe student's ability to evaluate, stress-test, and refine raw AI outputs against constraints โ€” naming each catch as an Attribution Error (an unsupported or fabricated claim) or a Logical Error (a flawed deduction, even from an otherwise-true premise).Revision trails, error-tracking sheets, source-verification/fact-check logs, and written critiques of AI-generated content.Gemini
Creative Art DirectionTaste, aesthetic consistency, and unique conceptual choices that override default AI biases.Annotated style matrices, mood boards, and mood-to-asset translation logs.Google Stitch
Domain Specific Knowledge ApplicationDeep visual communication craft โ€” typography, hierarchy, color, and compositional judgment โ€” applied skillfully enough to elevate AI-assisted output into original, intentional design work that reads as more than generic Gen AI.Typography and hierarchy exploration notes, color/composition rationale, design system documentation, and before/after visual craft comparisons showing the shift from generic AI output to an original visual direction.Google Stitch, Figma
Reflective ReasoningThe student's meta-cognitive ability to explain why they made specific curatorial choices โ€” framed as a legible reasoning chain, where each step should be independently defensible, not just the final conclusion.Timestamped process notes and file annotations with rationale, and a brand- and persona-driven reflective approach.Gemini Notebook / Gemini Gems
Direct Creative ContributionHuman authorship: what the student sketches, develops into original artifacts or moodboards, writes, or fundamentally transforms.Original source files and before/after authoring comparisons showing hand-finished or transformed work.Gemini Notebook, Google Stitch, Figma

How the Google Toolkit Powers the CPA Workflow

UX Research (Human-Led) โ€” brand candidate research, live site audit, user interviews, competitive analysis
โ†“
Gemini Notebook โ€” synthesizes research into brand profile, UX audit, and content brief
โ†“
Sitemap & Wireframes (Gemini, Gemini Gems, Google Stitch, Figma) โ€” information architecture and low-fidelity structure, content developed from research
โ†“
Gemini / Gemini Gems โ€” documents the cognitive trail and directs UX writing as COPYWRITER
โ†“
Moodboard & Art Direction (Human-Led: Figma) โ€” 3 directions proposed, reviewed, and selected
โ†“
Google Stitch โ€” generates the initial UI design from the chosen art direction
โ†“
Figma โ€” imports the Stitch output and refines it into production-ready UI
โ†“
Nano Banana (Gemini 3.1 Flash Image) and other visual resources โ€” generates visual assets and imagery integrated during Figma iteration
โ†“
Figma Design System โ€” typescale, styles, variables, and components built for the final responsive screens
โ†“
Student applies DOMAIN SPECIFIC KNOWLEDGE as ART DIRECTOR โ€” critiques, directs, refines, catches AI errors at every stage
โ†“
Periodic presentations โ€” student explains decisions, timestamping the record (verification + IP)
โ†“
CPA Assessment โ€” grades Thinking Design throughout the process, not just the final deliverable

90-Second Pitch for Session 1

"AI-native tools like Stitch can produce a polished-looking UI in seconds. But polish isn't mastery. What separates a trained designer from a generalist is how they direct that process from the first prompt onward โ€” the research decisions, the content choices, the interaction pattern caught before it violates user cognition, the accessibility failure caught before it ships. That expert direction, visible across every iteration, is the intellectual fingerprint. My solution is Cognitive-Process Assessment: a framework powered by Google Stitch, Nano Banana, NotebookLM, Gemini, and Gemini Gems that grades the invisible work โ€” the prompting logic, the curatorial judgment, the domain-expert decisions โ€” that defines a student's true mastery. This isn't a FIT solution. It's the global standard for any design program where AI has made the artifact an unreliable measure of skill."