I made sure I'm connected to the spark kernel instance associated with my Synapse Workspace account (as you can see in the second picture, the active session appears in the monitoring tab).
Regarding the second session, that's exactly the problem - I followed the instructions on the tutorial for reconfiguring the spark session:
I'm not sure how am I supposed to restart the spark session, does it mean to restart the kernel? (that's the only option which appears in the interactive window)
Note that the issue I described is for the case of an interactive spark session. For the case of spark job submission, you are correct - the jobs created for me are named "synapsebatchjobfromvscode" by default as well.
Hi,
I made sure I'm connected to the spark kernel instance associated with my Synapse Workspace account (as you can see in the second picture, the active session appears in the monitoring tab).
Regarding the second session, that's exactly the problem - I followed the instructions on the tutorial for reconfiguring the spark session:
I'm not sure how am I supposed to restart the spark session, does it mean to restart the kernel? (that's the only option which appears in the interactive window)
