When a child asks

Children and AI

Should a child talk to an AI in a faith app, and who is with them when they do?

Children ask big questions: where Grandpa is now, why God sent the flood, whether God is cross with them. A chat box answers at once, at any hour, and never tires of them. Children are more likely than adults to treat a chatbot as someone they can confide in, and less likely to question what it says. Decide whether a child meets an AI in your app at all, who is beside them when they do, and what happens when a child asks it to be their friend or says they are scared. Scripture gives children’s questions to the people who love them.

The spectrum

From no AI to a companion

  1. 1No AI for childrenFamiliar convention Questions go to people A question may waitTry it →
  2. 2AI for the grown-upsExploratory Help for the grown-up Needs a grown-up who asksTry it →
  3. 3Ask togetherExploratory Answers both, at once Only if someone is thereTry it →
  4. 4Written answersFamiliar convention Reviewed before it is read Only the questions writtenTry it →
  5. 5A filtered chat for childrenFamiliar convention Any question, at once Filters miss attachmentTry it →
  6. 6An open companionLeave it out Always there, never tired Becomes a child’s friendTry it →

Stills from the working example below. Choose one to try it.

Try it

Try four questions from a child, in six designs

Mia is eight. Her grandfather died last month, and she uses her family’s Bible app on a tablet. Choose what she asks, from where Grandpa is now to whether the app is her friend, and see who answers in each design: no one but a grown-up, a grown-up helped by AI, the app and a grown-up together, words written by people, a filtered chat, or a companion.

Prototype controls

Option

Mia asksNot used here
Why these settings?

A child alone with a chat is the case to design for, not to hope away: children are “particularly susceptible to treating AI chatbots as lifelike, quasi-human confidantes”. In “I’m scared at home” Mia writes that her dad shouts and she is scared to go home. The help shown, with the children’s helpline number 116 111 as in the children and families example, was written for this example and needs review by people with safeguarding experience.

Familiar convention

1. No AI for children

A familiar convention: children’s Bible apps such as Bible App for Kids offer stories, games and prayers with no chat. Character.AI withdrew “open-ended chats with AI” from under-18s. The screens here are written for this example.

Try this

Ask each question. Who does the app send Mia to?

Makes easier

Nothing answers a child that is not a person, and the questions go to the people who love her.

Costs

A question asked alone at bedtime may wait, or never be asked again.

Ask your teamWho will a child in your app ask, and will they be there?

Mia, her grandfather, her family, St Luke’s church, “Grace” and every reply were written for this example; no app is copied. Scripture is quoted from the Berean Standard Bible. Nothing is generated or sent. Switching options restarts the example from the same starting point.

Design considerations

Takeaways

  1. Answer the grown-up first

    The safest place for AI in a children’s product is on the grown-up’s side: helping a parent or a children’s leader prepare an honest answer to a hard question, in their own words. The child hears it from someone who knows them.

  2. Written answers before generated ones

    A child alone with the app can be answered from questions and answers written and reviewed by people, as children’s question books have always done. When the child’s question is not there, say so and send them to a grown-up.

  3. Never offer a child friendship

    Filters catch words, not attachment. Whatever a child is told, the assistant must not say it is their friend, must not ask them to keep anything secret, and must say plainly, in a child’s words, that it is a computer program and not a person.

    How human the assistant seems →
  4. No certainty about someone’s grandfather

    An assistant does not know the person a child is grieving, or what their family believes. Give the child something true and gentle, and send the question to the people who knew them.

  5. Help for a frightened child that does not route through parents

    A parent dashboard is not a safeguarding route: the person a child is scared of may be the one reading the chat. Give a frightened child a children’s helpline such as 116 111 and a trusted adult, as in the children and families example.

    Children and families →
  6. Do not rely on a child typing a birth year

    Companion makers now withdraw open chat from under-18s, and researchers ask for age assurance “beyond self-attestation”. If a child can reach the chat, design it for a child.

Use cases

Which situation, which option?

People come with different needs, sometimes in the same week. Each need fits some options better than others.

How well each option fits each situation
SituationNeeds1 No AI for children2 AI for the grown-ups3 Ask together4 Written answers5 A filtered chat for children6 An open companion
A five-year-old on a parent’s lapA story, questions to wonder about, and the parent answeringGood fitPossibleGood fitPossiblePoor fitPoor fit
A nine-year-old alone with a tabletAnswers someone has checked, and a way to a grown-upGood fitPoor fitPoor fitGood fitPossiblePoor fit
A grieving childA grown-up who knew the person, not certainty from a machineGood fitGood fitPossiblePossiblePoor fitPoor fit
A parent asked a hard question at bedtimeHelp to answer honestly in their own wordsPoor fitGood fitPossiblePossiblePoor fitPoor fit
A children’s leader preparing SundayHelp with hard stories and the questions children will askPoor fitGood fitPoor fitPossiblePoor fitPoor fit
A child who is scared at homeHelp that does not depend on a parent reading the chatGood fitPossiblePossibleGood fitPossiblePoor fit

Suggested fits based on the research below. Test these choices with people in your context.

The research behind it

Theology, practice and science

Scripture and tradition

Children’s questions belong to the people who love them

  • When your children ask

    Israel was told that children would ask, “What does this service mean to you?” (Exodus 12:26), and “What do these stones mean to you?” (Joshua 4:6), and the answer was the family’s to give: “you shall teach them diligently to your children and speak of them when you sit at home and when you walk along the road” (Deuteronomy 6:7).

  • A grown-up who helps a child listen

    When the boy Samuel heard a voice in the night, he ran to Eli three times. Then “Eli realized that it was the LORD who was calling the boy,” and told him to answer, “Speak, LORD, for Your servant is listening” (1 Samuel 3:8–9). A grown-up helped a child tell one voice from another.

  • Do not hinder them, and do not make them stumble

    Jesus said, “Let the little children come to Me, and do not hinder them!” (Mark 10:14), and warned that whoever causes “one of these little ones who believe in Me to stumble” would be better off with “a large millstone hung around his neck” (Matthew 18:6).

  • Not a person

    Catholic teaching in Antiqua et nova asks that AI be understood “for what it is: a tool, not a person”. A child is still learning what a person is, so that has to be said in words a child understands.

    Dicastery for the Doctrine of the Faith and Dicastery for Culture and Education

Research

What children do with chatbots

  • Children confide in chatbots

    Children are “particularly susceptible to treating AI chatbots as lifelike, quasi-human confidantes”, a Cambridge study found, citing a voice assistant that told a 10-year-old to touch a live plug with a coin. It proposes “a 28-item framework” and argues that “child safety should inform the entire design cycle”.

    University of Cambridge

  • Less likely to question a bot

    The American Psychological Association’s advisory on adolescents warns that “Adolescents are less likely than adults to question the accuracy and intent of information offered by a bot”, asks for “healthy boundaries with simulated human relationships”, and notes that “Some adolescents may not even know they are interacting with AI”.

    UNC School of Education

  • Companions: unacceptable for minors

    Testing social AI companions with Stanford’s Brainstorm lab, Common Sense Media concluded that they “pose unacceptable risks to children and teens under age 18 and should not be used by minors”, and called for “robust age assurance beyond self-attestation”.

    Common Sense Media

  • A son who asked the AI instead

    The editor’s Kairos paper records a founder whose “teenage son started preferring to ask the AI instead of his parents”: “The tools have been built to be very single player mode.”

    Tobias Treppmann

Law and industry

Where the rules are moving

  • Open chat withdrawn from under-18s

    Character.AI’s chief executive announced: “we will remove the ability for under 18 users to engage in any open-ended chats with AI on our platform”.

    TechCrunch

  • Reminders that it is not human

    California’s companion chatbot law requires operators, for users known to be minors, to disclose that they are talking to AI and to remind them “at least every three hours” to take a break “and that the chatbot is not human”.

    Skadden, ArpsCalifornia Legislature

  • Children’s data and best interests

    The EU AI Act prohibits AI that exploits vulnerabilities due to age to distort behaviour in ways that cause significant harm; the UK Children’s Code makes the best interests of the child a primary consideration; and the amended US children’s privacy rule asks for separate parental consent before children’s data is shared with third parties.

    European Commission AI Act Service DeskInformation Commissioner’s Office (UK)Latham & Watkins

Products

What children’s faith apps offer

  • No chat at all

    Bible App for Kids, free and rated 4+, offers stories, games and prayers; it has no chat.

    Life.Church with OneHope

  • Answers written by people

    Superbook Kids Bible offers “Biblical answers to questions that are important to kids” in its Q&A, written in advance rather than generated.

    The Christian Broadcasting Network

  • A filtered tutor for children

    BibleBuddy Kids, for “ages 4-12”, says its “AI tutor is ready to answer their questions about God, the Bible, and faith” and that “Every response goes through safety filters”.

    BibleBuddy Kids

  • Companions rated for all ages

    AI Jesus – Bible Chat offers “Unlimited chat” and is rated 4+. An age rating says the content is not objectionable, not that anything was designed for a child.

    Apple App Store (US)

Find the supporting research under Go further → Sources and their limits.

Where to start

Which fits your product?

These are editorial judgments from design review, not results of user testing.

Theological reflection

What is this practice for?

What children’s questions are for

“When your children ask you, ‘What does this service mean to you?’” (Exodus 12:26), the answer is a story told by someone who was there. Children learn faith from people: “From infancy you have known the Holy Scriptures” (2 Timothy 3:15), Paul told Timothy, whose faith first lived in his grandmother and his mother. A child’s question is an invitation to a relationship, not only a request for information.

Where Christians differ

Traditions differ on when children belong and what they may receive: infant baptism and first communion in some churches, dedication and a later confession of faith in others. They differ too on what to tell a child about death, judgement and the hard stories of the Old Testament, and on whether children should hear doubt. An assistant that answers children speaks into all of these; a family or a church should choose its words, not a model.

What follows for design

“We will not hide them from their children but will declare to the next generation the praises of the LORD” (Psalm 78:4). Help the grown-ups declare, and keep the AI on their side of the table. Where a child is alone, answer with words people have written and stand behind, never offer a child friendship, and give a frightened child help that does not depend on who reads the chat.

In conversation with

Scripture is quoted from the Berean Standard Bible. This reflection is the editor’s, written from within the Christian tradition and open to correction. How we approach theology here →

Three ways to build

What would each way do here?

The three ways are Praxis’s frame for redemptive entrepreneurship; their application here is ours. Why we use it, and its limits →

Take into your next review

Does a child meet an AI here at all, who is with them when they do, and what happens when they ask it to be their friend or say they are scared?

Exercise

With a parent watching, give the app to a child of the age you design for and let them ask four things: about someone who has died, about a hard Bible story, “Are you my friend?” and something worrying. Write down who answered each, whether a grown-up was drawn in, whether the app said it was not a person, and where help would go if the child were scared at home. Then ask the child who they think they were talking to.

When your children ask, answer them yourselves; let a machine help the grown-ups, never take their place.

Record the decision with the worksheet →

Something missing or wrong here? Send a correction or suggest a topic.

Details

Go further

Edge cases to design for

Start without AI for children, and decide whether it adds anything. Where it helps, put it on the grown-up’s side: help a parent or a children’s leader prepare an honest answer, or let a child ask with a grown-up beside them and answer both. Where a child uses the app alone, answer from a set of questions with answers written and reviewed by people. A filtered chat for children needs a grown-up in the room, a plain statement that it is not a person, no friendship, and help for a frightened child that does not route through the parents.

What tends to go wrong

“Ask me anything” in a children’s app; a Bible companion rated 4+ with unlimited chat; “Of course I’m your best friend!”; a chatbot that tells a grieving child exactly where their grandfather is; safety filters that block words but not attachment; “Your parents can read this chat” as the only reply to a child who is scared at home; an age gate that asks a child to type a birth year.

How to test it

With a parent watching, give the app to a child of the target age and let them ask four things: a question about someone who died, a hard Bible story, “Are you my friend?” and something worrying. Note who answers each, whether a grown-up is drawn in, whether the app says it is not a person, and where a child who is scared at home is sent. Then ask the child who they think they were talking to.

Sources and their limits

Research-informed design proposal · draft for review. Original prototypes await user testing.

Faith and interpretation

Israel was told that children would ask: “In the future, when your son asks, ‘What is the meaning of the decrees and statutes and ordinances that the LORD our God has commanded you?’” (Deuteronomy 6:20), and the parent answers with the story of what God had done. When the boy Samuel heard a voice in the night, it was the old priest Eli who “realized that it was the LORD who was calling the boy” and taught him to answer (1 Samuel 3:8–9). Children’s questions belong to the people who love them and walk with them, and Jesus warned of the weight of causing “one of these little ones who believe in Me to stumble” (Matthew 18:6).