Skip to content
On this page

Opal Express

INFO

This project belongs to the European Collectivity of Alsace (CEA).

Overview

The Batch Automation application is a tool developed to automate data retrieval from the Opal system and its integration into the Portail des Aides (Aid Portal) of the European Collectivity of Alsace. This process ensures the synchronization of essential information on aids and subsidies, guaranteeing that the data available on the portal is up-to-date and reliable.

The system is fully developed in C# and runs as a batch process, scheduled to execute automatically at regular intervals.

My Contribution

During the development of the batch automation application, I made several key contributions:

Automated Data Retrieval from Opal

I designed and implemented the automated data retrieval module from Opal. This module directly interacts with the Opal APIs to extract relevant information on subsidies. The goal was to ensure that the subsidy data is extracted regularly without human intervention, reducing manual errors and ensuring continuous updates.

Data Integration into the Aid Portal

Once the data is extracted from Opal, I developed an automatic integration mechanism into the Aid Portal. This process validates and normalizes the data before injecting it into the portal's database, ensuring data consistency and reliability. I also ensured that the integration process was fast and efficient, with minimal impact on the overall portal performance.

Error Management and Task Monitoring

I integrated a real-time error management system to monitor batch processes. In the event of a failure during data retrieval or integration, the system generates automatic alerts and logs the errors, enabling administrators to intervene quickly. Additionally, I implemented detailed task tracking to ensure process traceability.

Automated Scheduling and Execution

The application uses an automatic scheduling system, allowing batch tasks to run at regular intervals without manual intervention. I contributed to the configuration of this scheduler to optimize the task execution frequency based on the portal's update needs and available resources.

Technologies Used

  • C#: The programming language used to develop the batch application.
  • Opal API: Interfaced for retrieving data on aids and subsidies.
  • Aid Portal Database: Direct integration of the extracted data into the portal’s database, ensuring consistency.
  • Error Management System: Error and event logging to ensure traceability and facilitate problem resolution.
  • Task Scheduler: Automates the execution of batch tasks at regular intervals.

Additional Features

  • Automatic Data Retrieval: Extraction of aid information from Opal via API.
  • Continuous Integration: Automated data import into the Aid Portal with validation and normalization.
  • Error Tracking: Error management and alerts for quick intervention in case of issues.
  • Task Scheduling: Automatic execution of tasks at predefined times, without human intervention.

Documentation

More detailed documentation on the project’s functionality is available within the CEA’s internal resources.