Efficient Streaming Pipelines at Scale
A special joint technical webinar with solution architects from Databricks and Plotly
December 13, 2022
Streaming data has become ubiquitous across a wide range of applications, from IoT technologies to transportation route planning and real-time financial reporting. But tailoring streaming tools to fit organizational criteria can prove challenging, especially when seeking to operationalize such workflows at scale. Legacy system architectures often present roadblocks and slow down data science workflows.
Databricks and Plotly Dash showcase a combined solution to ensure fast processing and visualization of such data, in real-time, even with large volumes.
In this recorded technical session, solution architects from Databricks and Plotly will walk through the following:
- Building the back end of a Dash app with the Databricks Structured Streaming solution
- Using the Databricks SQL python connector to connect to Dash
- Leveraging the efficient Databricks Photon query machine with the dcc.interval Dash component
- Deploying interactive, customizable large data apps at scale with Dash Enterprise