Google Cloud has announced new capabilities that make running Dataproc Serverless faster, easier, and smarter. These capabilities include native query execution, a built-in Spark UI, streamlined investigation, and proactive autotuning and assisted troubleshooting with Gemini. Native query execution is available in the Premium tier and offers significant speed improvements for Spark batch jobs. The built-in Spark UI is available by default for all Spark batches and sessions, eliminating the need to set up persistent history server clusters. A new "Investigate" tab simplifies troubleshooting batch jobs by displaying essential metrics highlights and logs filtered by errors automatically. Gemini can minimize failures and autotune performance based on historical patterns, and provides AI-powered insights and recommendations for quick troubleshooting.
Dataproc Serverless: Now faster, easier and smarter
Google Cloud