Processing multiple data files dynamically using azure databricks pyspark notebook

Hi,

I have a requirement to process multiple data files having different no of columns using azure databricks pyspark notebook and want to use a single notrbook file to dynamically   process those data files having different nos of columns. i dont want to write multilple notebook scripts to process hundreds of files .Please let me if anyone has done similar exercise in the past and how to go abt it.thanks a lot .Shatamjeev