Forum Discussion
spark pool taking more than 10m mins to start
I have created 3 notebook by selecting the language as Pyspark. spark pool is taking more then 10 minutes when starts executing the notebook. Running these notebooks sequentially, each time spark p...
i don't have a direct answer for this, because we used databricks for spark. Can you create a databricks cluster, and invoke the job from Synapse pipeline and check ? Because, in databricks you can utilize "cluster pool" concept. Check and lets us know.
- Hi azdelta2022,
if we will call databricks using synapse then no benefit of Synapse Spark pool and even synapse.- Hi kashif_m , can you try using databricks first and see if you are able to achieve the "warming" the instance ?
