The Peter MacCallum Cancer Centre and the John Holland Group, an infrastructure and construction company, have turned to cloud information and the AI system Databricks in Australia to address major information separation issues that were preventing them from extracting insights from company data.
Speaking at Databricks ’ Data + AI World Tour in Sydney, Australia last month, tech leaders at both organisations reported facing challenges such as siloed data, competing business areas, data integration issues, and legacy systems, prompting the need to seek a cloud data solution.
The Peter MacCallum Cancer Centre combines information to create AI.
With its extensive clinical and research operations, Peter Mac’s legacy data infrastructure made it difficult to properly use large data and AI. The outdated technology also jeopardized its effort to make improvements to the life of cancer patients, including the use of AI to facilitate medical decision-making and speed up the development of natural insights and drugs.
Problems with data network
During the meeting, Jason Li, mind of the biology base hospital in Peter Mac’s tumor study division, said that:
- Peter Mac was working with various stale and fragmented techniques.
- In areas like data backup and data analytics, the tumor center’s operations were challenged by the difficulty and quantity of both clinical and research data.
- The management of Peter Mac’s data and the development of any upcoming AI use cases were all impacted by honest, privacy, and safety concerns.
- Because each department had unique data requirements, interdependence between the clinical and research departments made the data management problem more difficult.
Observe: Informatica claims that APAC’s data separation poses a challenge to AI.
Li claimed that Peter Mac chose Databricks to assist in harmonising data across the organization and supporting developed insights, including AI, while adhering to the health care data security and privacy requirements.
expanding to novel use cases for AI
Peter Mac initially tested the AI possible of the Databricks system through a pilot project for AI transformation:
- In order to identify a novel marker for breast cancer outcome, the center developed an end-to-end AI cycle that involved using deep learning to analyze gigapixel whole-slide images.
- According to Li, databricks supported the AI lifecycle, from preliminary data ingestion to type deployment and monitoring, which made the task time and cost-effective.
- The benefits of the project could have “great promise ” for enhancing breast cancer outcome.
According to Li, rate was a significant advantage of the project:” We believe we have sped up the development process by tenfold and by tenfold communication overheads across stakeholders, thereby enabling us to take innovations to the market sooner to gain patients. ”
Potential projects are now included in the AI method.
AI has grown into a larger portion of Peter Mac’s plan. Databricks is supporting the cancer center in three more employ cases: genomics, rays oncology, and malignancy imaging. Also, Peter Mac is:
- expanding the Artificial plan to include popular bioinformatics, such as population genetics tasks that involve significant sample sizes and large amounts of genome data.
- applying new developments in large-scale models and retrieval-augmented era to extracting information from radiological and medical reports.
- In order to remain competitive in cancer research, LLMs are planned to be implemented in the future for genomics and transcriptomics studies, which analyze RNA or the microbiome.
John Holland aims to bring together information from all types of design work.
However, John Holland managed 80 large-scale infrastructure projects for AUD$ 13. 2 billion in 2023. But, Travis Rousell, the firm ’s mind of data and analytics, said its reputation data warehouse atmosphere was divided and difficult to integrate.
Observe: How to enhance data quality in information lakes
“We’ve got all the common problems everybody’s had previously with information warehouses and data issues, ” Rousell said. Our traditional data warehouse atmosphere was developed over the course of 20 years. We’ve created this incredibly overburdened set of data warehouses as it has gradually evolved and developed out. ”
We could create reports and BI [ Business Intelligence], but joining that information up to be able to uncover patterns in the flow of activities and behaviors that are occurring to enable us to effect change in our business has been a really challenging procedure for us, Rousell said. ”
a unified information program to provide relevant insights
To access data for enterprise value, John Holland sought to build a unified information platform. As part of a broader push for electric change, the team made an effort to promote creativity and a competitive advantage in its sector through current data and digital practices.
The organization has attempted to:
- provide a consolidated and comprehensive view of data across the company.
- manage data governance across projects that are independently managed.
- Concentrate more on data engineering than platform engineering.
Cost savings come from better data management
John Holland has so far delivered several core business processes to Databricks ’ data lake, including project management, project operations, project controls, safety, and fleet analytics.
As a result of using Databricks, Rousell said that John Holland had:
- Reduced platform infrastructure costs by 46 % on like-for-like workflows compared with legacy environments;
- By creating new data products and models, reduced the effort and time spent on data engineering development by 30 %.
- More than 600 users were migrated to data products provided by the Databricks Data Lakehouse.
IT becoming an enabler for John Holland’s business
According to Rousell, Databricks makes sure that the business’s advancement is not impeded by IT and technology.
“ I think the biggest thing for me that we’re achieving by doing this is we’re creating this data culture of ‘yes ’ within John Holland, ” Rousell explained. We’ve historically had to stand up large slow projects and underdeliver for the business due to the difficulty in providing new and innovative products.
“Now, if the business has an idea, we can say yes; We can give them access to all the tools and capability they will need by creating a data workspace that they can use quickly. ”
