This presentation showcases how the Scientific Domain Expansion team within Content Operations transformed and modernized our approach to data ingestion, review, and harmonization—significantly increasing efficiency, scalability, and overall data quality. Previously, creating and validating new XML datasets required substantial manual effort, often involving 4–6 team members and covering less than 10% of mapped data over multiple review cycles spanning several days. Similar challenges arose when validating MarkLogic ODH updates, where achieving comprehensive data coverage through manual checks alone was not feasible.
To address these limitations, we implemented a more scalable and automated approach by leveraging ODH production data, MarkLogic scripts, and Excel-based validation techniques. These tools allow us to perform bulk checks across entire datasets, quickly identify mapping issues, and collaborate with developers to validate updates and catch errors early in the process.
As a result, tasks that once required days of effort and multiple reviewers can now be completed by a single individual in minutes to hours—delivering faster turnaround times, increased coverage, and improved confidence in data quality.
Video Stream
