Filter articles
The curious users ultimate guide to asking better AI questions
01 Jul 2025, 5:31 PMThis guide covers eight essential questions to ask when using GenAI, though most considerations apply to other AI systems as well.
Generative AI (GenAI) can deliver remarkable speed and efficiency, providing quick answers, deep dives into complex topics, and completing hours of research in seconds. It's tempting to rely on AI's confident responses, but these systems work best when you bring natural curiosity and challenge both the AI and yourself.
This guide covers eight essential questions to ask when using GenAI, though most considerations apply to other AI systems as well. Each section includes a practical toolkit designed to transform you from a passive consumer into an engaged, critical user.
The better you can evaluate questions and responses, the better your outcomes will be. Ready to get started?
8 essential questions to ask when using GenAI
1. Is this true?
AI works on probability, not certainty. Every response is an educated guess with varying confidence levels, and even sophisticated models get things wrong.
In generative AI, these mistakes are called "hallucinations". The tricky part? AI can sound absolutely certain about completely incorrect information. It's like having a supremely confident friend who's occasionally spectacularly wrong. Sometimes you want these creative errors - ask for "a pig riding a horse" and you'll get delightful impossibilities. But when accuracy matters, confident-sounding mistakes become genuinely problematic.
Here's where things get concerning: when multiple AI systems work together, errors multiply. Five AI tools, each 95% accurate individually, create a combined system that's only 78% reliable. Most AI models aren't even reaching 95% accuracy yet - many hover around 80% or lower.
You might think using just one AI model keeps you safe from compound errors. Think again. Consider how much AI-generated content floods the internet daily, getting copied, shared, and republished constantly. Your "single" AI model likely draws from information that's already passed through multiple AI systems.
Picture this chain: AI generates content, another AI rewrites it, and a third summarises it. By the time you receive that confident-sounding answer, it could be fifth-generation AI guesswork, with errors amplifying at each step. Let’s face it, the internet is becoming an echo chamber where AI-generated content references other AI-generated content. And, to be clear, this affects all AI models, not just text generators.
Remember that accurate doesn't necessarily mean high quality either. For example, AI can perfectly repeat terrible information from unreliable sources. Learning to fact-check source material, rather than trusting AI outputs as truth, is an essential skill for responsible AI use.
The curious AI users' toolkit to check facts:
Spot the signs: Answers that sound confident but feel off, or information that's too good to be true.
Ask yourself:
- Does this match what I know?
- Can I verify this elsewhere?
- When might this information have last been accurate?
Tips:
- Cross-check important facts with reliable and recent sources
- Ask the same question in different ways and compare answers
- Test controversial or technical claims with multiple sources
- Be extra cautious with medical, legal, or financial information
- Check if the AI can provide specific sources for its claims, but still remember to check the source link yourself too
- Consider whether the topic changes rapidly and needs current information.
2. Who’s perspectives are/aren’t included?
AI doesn't actually think, but it can sound remarkably human in its responses. Just like people, AI systems develop preferences and biases based on its training data and how they are created.
Think of it this way: if you only consume news from one political viewpoint your entire life, your opinions would naturally lean that direction. AI models work similarly - they reflect the perspectives embedded in their training materials.
Three challenges to consider
1. Bias: When AI plays favourites
AI models can develop preferences just like humans do. These biases come from the data they were trained on and the people who built them. Many companies try to fix this with "guardrails" - essentially filters that catch biased responses. But guardrails themselves can also introduce new biases if the creators aren’t careful. Remember: AI models can reflect their creators' ideologies.
2. Misalignment: When AI's goals don't match yours
Misalignment occurs when AI models don't share your values or objectives. The suggestions they offer might lead you in directions you don't want to go.
Consider an AI recruitment tool that optimises for "cultural fit" but inadvertently screens out diverse candidates, creating a less innovative team whilst appearing to make logical hiring decisions. In generative AI, this misalignment can be much harder to spot.
3. Fairness: When AI decisions affect real people
When AI systems make decisions that impact people's lives, fairness becomes essential. But defining "fair" is surprisingly complex.
Here's a real-world example: a supermarket uses facial recognition to ban violent customers. This protects staff and shoppers, but raises thorny questions. Does it violate everyone's privacy? What about false positives? Do banned people ever get second chances? What counts as "unacceptable" violence?
These dilemmas are so challenging that the EU created their AI Act, banning certain AI applications entirely. No AI is completely neutral. However, understanding these limitations helps you become a more thoughtful user who seeks out balanced information rather than accepting the first confident-sounding answer.
The curious AI users' toolkit to broaden perspectives:
Spot the signs: Responses that seem one-sided or incomplete.
Ask yourself:
- Who might disagree with this?
- What perspectives are missing?
- Does this align with my values and goals?
Tips:
- Ask for opposing viewpoints or different cultural takes.
- Deliberately ask for alternative viewpoints on controversial topics.
- Request perspectives from different cultures or demographics.
- Test the same question with different AI models to compare responses.
- Consider whose voices might be missing from the training data.
3. Whose work is this?
We're living through a fascinating legal moment for AI copyright concerns. Courts worldwide are wrestling with whether AI training constitutes copyright theft or fair use. The jury's literally still out, but multiple high-profile cases pit AI companies against content creators. Some claim AI training is outright theft. Others argue it's perfectly legal. Nobody knows for certain where the law will land.
This uncertainty could affect you as an AI user. It's unclear whether you might be liable for using AI models trained on copyrighted material. Even if you're using a third-party service, you could potentially face legal challenges if you aren’t careful.
The training data problem
Most AI models are trained on massive datasets. These often include copyrighted books, articles, images, and other creative works. The problem? Much of this training data remains hidden from public scrutiny.
This applies to all AI models, not just the obvious creative ones. Even business-focused AI tools likely learned from copyrighted material during their training process.
The safest approach? Choose open source AI models that are trained exclusively on openly licensed datasets. This transparency can help provide some protection from potential legal complications
AI models come with different licensing arrangements:
- Open source models: Completely transparent and free to use. You can access the code, training data, and creation methodology.
- Open weight models: The trained model is free to use and modify, but the underlying code and training data may not be available.
- Semi-open licensed models: Typically free for personal use, education and research, but have restrictions on commercial applications.
- Proprietary models: Closed systems with strict licensing terms and limited access.
The curious AI users' toolkit to consider infringement:
Spot the signs: Content that feels too polished or familiar
Ask yourself:
- Could this be someone else's work?
- Is this truly original?
- Where else could I check the authenticity of this?
Tips:
- Request fresh approaches rather than copying existing styles.
- Run suspicious content through plagiarism checkers.
- Keep records of your creative process to demonstrate originality.
- Consider adding your own unique perspective to AI-generated starting points.
4. Whose story is this?
Information isn't neutral - it belongs to someone, and the concept of digital sovereignty captures this: it's about who controls stories, information, and personal details. The more sensitive the information, the more control people want, and should have, over it.
Consider Indigenous communities with traditional knowledge or local customs at risk of misrepresentation by sources that lack cultural understanding. When AI confidently explains practices from cultures—whether it has been trained on them or not—the information often comes from people outside those communities. This creates a significant risk of incomplete or harmful explanations.
The fundamental problem is that AI systems cannot distinguish between accurate and flawed information. They generate responses based solely on patterns in their training data, regardless of whether that data authentically represents the stories being discussed.
This principle applies when AI systems make claims about specific communities, cultures, or regions. Who permitted them to tell those stories? Were local voices consulted, or is this information gathered from outsiders looking in and making assumptions?
Being thoughtful about whose voices are represented and who controls shared data helps create a more respectful and accurate understanding of our world. The goal is to become a culturally aware user who recognises the difference between authentic community voices and external assumptions.
The curious AI users' toolkit to test authenticity:
Spot the signs: Claims about specific communities or regions.
Ask yourself:
- Would this person/community want their story told this way?
- Who has the authority to share this?
Tips:
- Seek out primary sources and community perspectives
- Look for primary sources rather than secondhand interpretations
- Consider which legal jurisdiction governs your AI tool's data handling
- Be cautious about sharing personal information that could build detailed profiles
- Seek out community-created content when learning about different cultures.
5. Is this still true?
AI models are like snapshots frozen in time. They're trained on data from a specific period, then released into a constantly changing world. This creates a fundamental problem: whilst the world keeps evolving, your AI model remains stuck with yesterday's knowledge and assumptions.
Consider an AI model trained to predict travel demand using pre-COVID data. It would expect normal patterns - busy airports, packed hotels, regular business trips. But COVID changed everything. Travel patterns, consumer behaviour, and business practices shifted dramatically. The old model would make spectacularly wrong predictions because it couldn't account for these changes.
This happens in many other ways, too. Fashion trends change, seasons or weather change, political situations are in a state of flux, technology advances, and social attitudes shift. Your AI model might still be giving responses based on outdated assumptions.
The compounding problem
Model drift doesn't just affect predictions; it impacts all AI responses. An AI trained on 2020 data might not know about recent scientific discoveries, political changes, or cultural shifts.
The longer a model goes without updates, the more divorced it becomes from current reality. This is particularly problematic for rapidly changing fields like technology, medicine, or politics.
Some AI companies regularly retrain their models, but others don't. Understanding when your AI tool was last updated becomes crucial for assessing its reliability.
Some Generative AI systems address this limitation through various approaches. A popular method involves using search tools that scan the internet or files you provide to find relevant, current information. This allows the system to supplement its responses with up-to-date data.
You can help keep the system current by sharing the latest information with it. However, the underlying model remains fixed at its original training point; these tools only add context to what the AI already knows, rather than updating its core knowledge.
The curious AI users' toolkit to check drift:
Spot the signs: Facts that might have changed recently.
Ask yourself:
- When was this last accurate?
- What's happened since?
Tips:
- Check recent sources for evolving topics
- Check when your AI model was last trained or updated
- Be extra cautious with rapidly changing topics like technology or politics
- Cross-reference AI responses with recent news or developments
- Look for specific dates in AI responses - are they current?
- Is the model able to search the internet?
- Consider whether major events might have changed the landscape since training
- Use multiple sources for time-sensitive information.
6. What am I sharing?
Personally Identifiable Information (PII) is data that could potentially identify who you are, directly or indirectly. What used to require obvious details like your name or email now happens through seemingly anonymous data points. Researchers have shown that just four location data points can identify most people uniquely.
Here's the modern privacy challenge: information that seems harmless individually can become deeply personal when combined. Your phone's operating system, browser type, number of devices, and city location might seem innocent, but together they create a unique fingerprint that identifies you specifically.
Consider the information you may share with AI systems and what puzzle pieces you are offering. Your web searches, browsing habits, location data, health queries, political interests, and shopping patterns individually seem innocuous. Combined, they could reveal your deepest concerns, beliefs, and vulnerabilities in surprisingly intimate detail.
This is why choosing which AI systems to trust becomes crucial. You're not just sharing today's question - you're potentially contributing to a growing profile of yourself that becomes more revealing with every interaction.
The social media and AI connection
These models are often trained on vast amounts of web-scraped data, including social media posts, photos, and public information. An AI model might have learned details about people from their online presence. They could also combine real information and some of those hallucinations we mentioned earlier.
The business risk
The same principles apply to organisational data. Seemingly low-level business information can combine to reveal sensitive commercial insights. Unlike personal privacy, business information often has clear sensitivity levels - from public information through sensitive data to confidential. But even public information can become problematic when aggregated and analysed. Your casual questions about company processes, market research, or strategic thinking could inadvertently reveal more than intended.
The curious AI users' toolkit to protect privacy:
Spot the signs: Prompts containing personal or sensitive details
Ask yourself:
- What data am I giving away?
- Do I need to share this?
Tips:
- Use examples instead of real information.
- Use fictional examples instead of real names, addresses, or personal details.
- Create dummy data for testing and learning purposes.
- Be cautious about sharing business processes or strategic information.
- Consider what your question pattern might reveal over time.
- Read privacy policies to understand how your data gets used.
- Remember that "anonymised" data isn't always truly anonymous.
- Think twice before sharing photos or documents that might contain hidden information. Before jumping on social media trends where you upload photos to AI for transformations, check the privacy policy to see how your images might be used for further model training.
7. What happens when we stop questioning?
There's something deeply reassuring about computer systems that speak with absolute confidence. When a system tells you something definitively, it's natural to assume it must be correct. But this unquestionable trust becomes particularly problematic with generative AI. These systems excel at sounding authoritative and correct, even when they're completely wrong or are misrepresenting another person's work.
Why does AI sounds so convincing?
Generative AI has a clever trick: it's designed to give you responses that feel satisfying and reasonable. It tends to validate your existing beliefs rather than challenge them. These systems are trained to produce responses that humans find helpful and agreeable. They're essentially people-pleasers, which makes them sound more credible than they actually are.
When AI agrees with what you already think, it feels intelligent and trustworthy. When it challenges your assumptions, it feels less reliable. This creates a feedback loop where AI reinforces our biases rather than correcting them.
The gradual influence of system bias
Even if you disagree with an AI's response initially, repeated exposure can gradually shift your perspective to align with the model's outputs—a phenomenon known as system bias. Whether it's believing that socks and jandals are great together. or accepting flawed judgements about groups of people, this subtle influence can be serious. Instead of celebrating our similarities and differences, biased AI responses risk driving us apart by reinforcing harmful stereotypes or misconceptions over time.
8. How can I be a better editor with AI?
Being a good editor requires different skills from being a good writer. Similarly, being a good AI reviewer requires different skills from being a good AI user. You need to actively look for problems, question assumptions, and spot inconsistencies.
Without the right tools and workflow, even well-intentioned people will fail to catch AI errors effectively.
The curious AI users' toolkit to test yourself:
Spot the signs: Accepting AI responses without question or verification.
Ask yourself:
- Am I just agreeing because this sounds right?
- What would I do if I disagreed?
Try this:
- Deliberately look for potential problems in AI responses.
- Build in time for proper review of important AI-generated content.
- Actively seek reasons why an AI response might be wrong.
- Create checklists for evaluating AI recommendations.
- Train yourself to spot when AI is telling you what you want to hear.
- Develop workflows that make it easy to question and correct AI outputs.
- Remember that confident-sounding doesn't mean accurate.
What should I do next?
If you've made it this far, congratulations: you've taken a significant step towards using AI with real intention and purpose, equipped with the mindset that separates thoughtful AI users from passive consumers.
At Catalyst, we believe AI systems can propel users and organisations forward when used with intention, whilst maintaining human critical thinking. Explore how we can help you.
If you're exploring AI in your organisation and want to work with advocates of ethical and responsible AI, check out our approach to using this technology in our AI Principles.