Query serverless SQL pool from an Apache Spark Scala notebook

Thank you for sharing this - This code worked for me but I ran into a problem in that I have a space in the column name. I saved the dataframe as a temp view and tried querying it with sparksql, everything works except when I try to reference a column that has a space in the where clause even when using the backtick. Any suggestions?

```

df1.createOrReplaceTempView('temp1')
df1 = sqlContext.sql("""select `Customer Id` from temp1 where `Customer Id` = 100 """)

I also tried:
%%sql
select `Customer Id` from temp1 where `Customer Id` = 100

Error:
Syntax error at or near 'Id': extra input 'Id'(line 1, pos 6)
```