Open Analytics Infrastructure
The aim for this project is to create an open-source analytics framework for the collection of event data in an Analytics Repository. The event data is collected from any tools/apps/systems that have the appropriate event instrumentation. The typical data to be collected includes:
- App usage and session event information
- Generative-AI responses and corresponding Prompt Engineering
- User feedback information
The framework uses the 1EdTech Caliper and the IEEE 9274, also known as xAPI, standards for the definition of the data interoperability format. A schematic representation of the data analytics framework is shown below.
Key points in this architecture are:
- The operation of the app(s) are instrumented so that the corresponding events can be streamed to the Analytics Repository using the ET4L Framework Sensor API (this can stream data in Caliper and IEEE/xAPI formats)
- The Analytics Framework supports the use of Generative-AI to analyze the text-based event data e.g. for User Feedback and Prompt Engineering
- The use of LTI as the single sign-on/launch protocol for the app means that the LTI Caliper Connection Service is used to configure app with the correct Analytics Repository endpoint information.
We hope to make Version 1 of the framework available in mid 2025.