Architecture Explained: generative AI based complex data processing

With the vast amount of LLM variations available, customers often struggle identifying the right provider and platform. Customers want to make sure their selection addresses their needs today and can accommodate future scenarios and use cases. In this session we will demonstrate how Databricks and AWS, together, maximize LLM choice providing customers an easy way to build and scale generative AI applications with foundation models from leading AI companies, along with a broad set of capabilities for security, privacy and governance.

Key takeaways include:
Interoperability between Databricks and AWS for generative AI applications
Data ingestion and document processing in real-time and batch
Databricks Auto Loader, Vector Store, Deployment AI Gateway and Amazon Bedrock
Lineage and Governance

Building a data-powered enterprise: Steps to success with Gen AI

Join Capgemini, Databricks and Informatica for an interactive session. Discover how to harness the power of generative AI to drive your enterprise's success. Learn why a robust data foundation is crucial and how we're overcoming common challenges. Don't miss this opportunity to connect with industry leaders and gain valuable insights. 

Data Foundation Transformation Journey

Presentation introduces transformation from monolithic data architecture into distributed data domain architecture, how to drive speed of execution enabling enterprise data reuse, and learnings and benefits from industrial scale implementation.

Efficient Use of Data Intelligence Engine for Clients

Databricks combines generative AI and the unification benefits of a lakehouse to power a Data Intelligence Engine that understands the unique semantics of your data. This capability enables the Databricks Platform to automatically optimise performance and manage infrastructure tailored to your business needs. This presentation will explore the value of utilising this platform for data democracy within organisations, highlighting various business cases developed in collaboration with the Nexer Group.

Four Years Married to Databricks: The Danskespil Journey

In this session, Danskespil reflects on their four-year relationship with the Databricks platform, detailing the evolution of their data architecture and analytics capabilities. As a company that transitioned from traditional data warehousing to a modern data lakehouse on Databricks, Danekspil shares insights into the challenges, successes, and lessons learned. Attendees will hear about how the platform has become an integral part of their operations, enabling scalability, innovation, and data-driven decision-making across the organization.

Helen: Building the Data & AI Powered Energy System

In this session you will hear why the carbon neutral energy system of 2030 will be Data & AI driven, what are Helen's main use cases and biggest business impacts, and how Helen is building their platform to power the flexible, automated, and constantly optimized energy system.

Leveraging data analysis for data product development in Pandora’s Marketing Analytics

This presentation explores the evolution of Pandora's Marketing Analytics from a siloed insights generation approach to an integrated, data-driven strategy that foster data product development of customer-centric solutions. The session exposes practical applications, highlighting the current tech stack supporting this transformation.

Rapid LLM Prototyping with OpenAI, Databricks, and Streamlit

At Gjensidige, Norway's largest insurer, one of the most important tasks for analysts and data scientists is the interactive visualization and simulation of data. In use cases such as risk prediction and asset management, they have established the Python-based package Streamlit as the preferred frontend for data-driven applications. In this talk, Alexandra Diem, Head of AI and MLOps, will walk you through the process of rapid LLM prototyping using OpenAI and Streamlit to create chatbots that heavily increase the efficiency of Gjensidige's internal processes. You will meet ""Eglev"", an innovative chatbot designed to empower without displacing tasks. Learn how Gjensidige turned Eglev from idea to working demo with greater than 91% accuracy in only 6 weeks. By making their lakehouse data available for non-technical resources by predicting SQL queries from natural language, Eglev allows Gjensidige's data scientists to focus on the most important tasks.

Scaling a data-mesh; 1-year into Novo Nordisk’s Azure Databricks journey

In Novo Nordisk Development we embarked September 2023 on an Azure Databricks implementation journey, to build a Clinical Data Repository for data generated as part of conducting clinical trials. Today we proudly have onboarded 30 teams and productionized 300+ schemas, and are looking to roll out Databricks company wide.

We share learnings, philosophy, and challenges ahead around scaling cross clouds (Azure+AWS), using ABAC to combat scale issues found in RBAC.

We dive into the process of GxP qualifying the data platform, and how DevOps ties into this. And we are very eager to join discussions with the more experienced community.

The CDO’s Imperative: 3 Moves Shaping Electrolux Group’s Data & AI Future

Discover how Electrolux Group is navigating the evolving landscape of Data & AI. In this session, George Linton, Chief Data Officer, will reveal the three critical moves driving Electrolux Group’s data and AI transformation, sharing real-world insights on strategy, value creation, and collaboration. Join the session to gain an authentic perspective on the challenges and successes that shape the future of data and AI.

The Cybersecurity Data Revolution: Empowering Security with Databricks

The integration of advanced data and AI capabilities is crucial for addressing today's complex cybersecurity challenges. This submission explores how Databricks' robust data and AI platform powers innovative cybersecurity use cases, bridging the gap between traditionally siloed cybersecurity and data organizations. Despite the critical need for collaboration, many organizations struggle with the maturity and integration of their cybersecurity and data functions. Databricks serves as a pivotal bridge, enabling seamless collaboration and enhanced security outcomes. Our platform's comprehensive security features, including real-time analytics, AI-driven threat detection, and robust data governance, empower organizations to minimize blind spots and enhance cyber-resilience.

The Data Intelligence Platform for Manufacturing

GenAI will transform the Manufacturing industry, but first, you have to overcome the obstacles that stand between you, your data and AI. Join this talk to learn how the Data Intelligence Platform supports Manufacturing organisations in driving value and democratise data and AI across your entire organisation.  

The Role of the Data Warehouse in Hyper-personalised Customer Experiences

Efficient data processing and agile decision-making are paramount to delivering a delightful customer experience. Modern data engineering, particularly the construction of real-time pipelines/data sharing, plays a pivotal role in transforming raw data into actionable insights. This session delves into Twilio Segment's Customer Data Platform (CDP) and our bi-directional integration with Databricks, focusing on a customer's quest to drive meaningful customer behavior. We will explore how customers stream first-party customer data into and out of Databricks, combined with Identity Resolution/Profiling of Segment's CDP that works with the Data Intelligence Platform to provide marketing teams the ability to supercharge their capabilities.

Unlock the Power of Data: Join the Path to Data Mastery

In today’s fast-paced and unpredictable market, staying ahead means leveraging data as a core strategic asset. But while every organisation talks about data, only a few truly master it. What differentiates these top-tier organisations? How are they using data to drive innovation, efficiency, and growth?

 

We’re excited to share our latest Data Mastery Report — an essential read for forward-thinking data leaders. This updated report reveals how the landscape has shifted: while many traditional challenges remain, their significance has decreased as new priorities like Generative AI take center stage.

 

Join us on this journey to data mastery. Discover insights, proven strategies, and actionable steps to position your organization as a leader in the data-driven future. Take the next step towards becoming a data-powered enterprise. Your path to data mastery starts here.

Unlocking Databricks Potential: Kongsberg Digital’s Data Warehouse Migration Journey

In October 2023, Kongsberg Digital embarked on a journey to migrate our cloud business data platform to Azure Databricks. One year later, we are proud to share that over 90% of our business-critical data has been successfully migrated, with new data sources seamlessly integrated.

Join us as we share valuable insights from our migration experience, highlighting the positives, challenges, and lessons learned. Key topics of this presentation include:

• Architectural Overview: A high-level overview of the architecture we employed.
• Working with Dynamics 365 and the Common Data Model: Our approach to integrating these essential tools.
• Utilizing Notebook Templates: How we leverage notebooks to streamline our processes.
• Added Value from Azure Databricks: Major wins and benefits realized post-migration.
• Challenges: The obstacles we faced and how we overcame them.

We look forward to providing a comprehensive look at our journey and offering practical takeaways for your own data platform migration projects.

When convenience becomes vulnerability: The hidden risks of streamlined systems

Efforts to simplify taxes and other financials has eased the reporting burden on people and businesses. However, this simplification, rooted in trust, has allowed criminals to manipulate data for illegal gains, turning a well-intended system into a loophole for fraud. 

Women in Data + AI Panel

The Women in Data + AI Panel discussion brings together data leaders to explore the topics of mentorship, allyship, and how we can bring women into tech roles. Our panellists will share their personal journeys, ideas and insights on how to navigate today’s industry landscape and the opportunities that being and having a mentor can shape and build your career path. The panel will also explore the importance of allyship, and what you can do to work with your counterparts within your organisation. This session is open to everyone to attend.