Social Impact Project for AI Creator SecureLearn - SAP Germany Cohort

Project Description and Impact

Background
The AI Creator is an AI-powered tutorial feedback system integrated into the DigitalSchoolStory learning method. In this method, learners create short videos—often in formats familiar from Instagram or TikTok—to communicate curriculum content creatively and effectively. Traditionally, feedback on these videos has been provided by human creators or influencers.

The AI Creator replaces this manual process with automated, high-quality, and age-appropriate feedback generated by AI. This feedback supports learners’ creative development, strengthens media literacy, and makes learning processes visible. By automating feedback, the system allows DigitalSchoolStory to scale to many more parallel projects without relying on the availability of individual creators.

Two prototype approaches have been developed:

Open-Source Stack (MariaDB, Apache, OpenUI5)
Cloud-based Google Stack (Google Firebase, Google Gemini API)

Both are designed to process learner videos securely, without storing personal data, and with strict adherence to privacy standards.

Why We Need Support
While the technical functionality is already proven through prototypes, the project faces a critical bottleneck in privacy and data protection compliance before it can be widely rolled out. Since the videos contain personal images of learners, even if no personal data is stored, the processing by AI (Google Gemini) creates legal and ethical challenges.

The organization seeks expert guidance in:

Finalizing legally sound consent processes for guardians.
Conducting an independent review of the privacy and security concept.
Determining the feasibility of hosting AI models (preferably Google Gemini) via non-profit or community-oriented providers to ensure maximum data sovereignty.

Relevance to the EU AI Act
Under the EU AI Act’s risk-based classification, the AI Creator is may fall into the medium- to high-risk range, with the final classification still to be assessed. The system operates in an educational context to provide feedback on learner-created content. While it does not manipulate or generate personal data, it processes video material containing identifiable individuals. This potential classification requires significant compliance measures, including risk management, data governance, technical documentation, human oversight, and, if deemed high-risk, registration in the EU database. Clarifying and fulfilling these obligations—particularly regarding bias prevention, transparency, and secure data processing—is a key reason the project needs external expertise before scaling.

This support is essential to ensure GDPR compliance, meet AI Act obligations, gain the trust of schools and guardians, and remove the “showstopper” barrier currently preventing large-scale deployment. Once the privacy framework is validated, the AI Creator can be scaled to empower thousands of learners to become critical, creative media producers rather than passive consumers.

Learning Opportunity

The experteer will gain hands-on experience applying generative AI in an educational setting, designing privacy-first systems, and navigating GDPR and AI Act compliance. They will work closely with a multidisciplinary team of developers, educators, and AI ethics experts – including two SAP alumni, a programmer and an IT project manager – applying Privacy by Design and Privacy by Default in a high-sensitivity domain. This includes risk classification, bias prevention, and developing scalable, ethical AI solutions.

Beyond the technical challenge, the experteer will directly contribute to empowering young people to become creative, critical thinkers and active shapers of the digital world. With DigitalSchoolStory, they will help transform passive media consumers into confident storytellers who understand how digital content works, question it critically, and use it responsibly. This work has a lasting impact on media literacy, digital sovereignty, and the democratic participation of future generations.