OpenEduAnalytics Versions Save

Release v0.1 of Microsoft Graph module

Updated the Ed-Fi Module installation process.

The initial release of the Ed-Fi module which is used to land, ingest and refine data from multiple Ed-Fi instances into the Data lake stored in ADLS.

Updated SIF module release. This release includes fixes as well as a new setup of synapse pipelines that demonstrate how to bring in a larger number of SIF entities, driven by a user-defined list.

<deprecated - see the latest release> Initial release of the SIF module

This release includes major changes to the data lake structure as well as the OEA api.Changes in this release include:

• completely revised data lake structure
  • newly named containers
  • introduction of "sandboxes"
  • new folder structure
• easily switch data lake contexts through use of oea.set_workspace
• extended use of OEA metadata format
• ability to convert swagger into OEA metadata
• updated provisioning of spark cluster to use spark v3.2 (instead of 3.1)
  • this also updates Delta Lake to v1.2 (from 1.0)

First release candidate for OEA framework v0.7

This is a release of the OEA framework prior to the coming major changes in v0.7

As it stands, all existing modules, packages, and schemas are dependent on this version of the OEA framework. In the future, these components will maintain a separate release cycle and will explicitly declare what version of the framework they are dependent on.

• Incremental batch data ingestion through OEA framework
  • Delta batch data
  • Incremental (additive) batch data
  • Snapshot batch data
• Enhanced module design simplifying data ingestion for standard batch scenarios
• OEA Framework catalog of Synapse pipelines
• common data extract pipelines
• end to end orchestration demonstration
• Hybrid engagement package
• Verified Credentials package
• ML tutorial package
• New and updated Microsoft modules (Intune, MS Insights, MS Graph)
• IPEDS module

Release notes

• Updated OEA framework setup script to simplify installation of framework into existing synapse workspace
• New framework assets including linked services, datasets, and pipelines
• OEA module creation kit
• Microsoft Graph API module - including pipeline, notebook, and power bi report
• Contoso hybrid engagement package - including pipeline, notebook, and power bi report
• Data generator framework and utilities
• Ed-Fi data generator