Issue while reading a csv file through Spark
I am trying to read a csv file through Spark. However one of the columns has the data in the below format and because of comma it is being split into multiple columns. The input csv file is a comma delimited file.
[{code: 100, name: CLS1, type: PRIMARY}]
could you please help me how to parse this column in spark scala.
I tried using option(escape,) and option(quoteMode,ALL). didn't work as expected
Topic json csv scala apache-spark
Category Data Science