The Need
As a Trusted Third Party, BGO Software developed an entire pipeline of patient data processing, enrichment, anonymization, validation, and post-processing for analytical needs. Our system manages to automate patients’ records, analyses, and research, secure every relevant data and add it to a completely automated pipeline of research material for the Clinical Research Industry.
The Challenge
Security was of main concern in a project like this. Anonymization of personal data, sensitive information, and additionally gathered items had to be thoroughly encrypted, before going into the stream of high-end research materials.
Our developers were faced with the up-most challenging tasks of:
- allowing secure access and data submission from hundreds of data sources
- ensuring PGP encryption and the highest possible security
- providing high concurrency (almost parallel) processing of a few hundred simultaneous operations in the peak moments
- adding fully transparent monitoring of the whole data processing the pipeline, having a clear understanding of the state and details for every single activity
Тhe Solution
BGO teams managed to obtain all of the required specifics and focus on the main goal of facilitating a secure way for interactions with distinct data, without exposing any additional information, besides the mandatory for fueling of a refined Clinical research pipeline.
Value Delivered
We developed from scratch a highly scalable data processing pipeline operating in a fully encrypted environment. The system is completely autonomous. It is easily processing a few thousand jobs per hour. It operates without a human.
