Liliam_C_Leme
on "Note 2": if you want to process multiple notebooks in parallel within the same session it is a little bit more complicated.
If you just have a plain for-each-loop in python calling `mssparkutils.notebook.run`, this will run the notebooks sequentially.
For parallel execution you have to make use of threadding in Python...
from concurrent.futures import ThreadPoolExecutor
timeout = 3600 # 3600 seconds = 1 hour
notebooks = [
{"path": "notebook1", "params": {"param1": "value1"}},
{"path": "notebook2", "params": {"param2": "value2"}},
{"path": "notebook3", "params": {"param3": "value3"}},
]
with ThreadPoolExecutor() as ec:
for notebook in notebooks:
ec.submit(mssparkutils.notebook.run, notebook["path"], timeout, notebook["params"])