Quantcast
Channel: Error when trying to load a file with sc.textFile whose name has a colon in it - Stack Overflow
Browsing latest articles
Browse All 2 View Live

Answer by Daniel Darabos for Error when trying to load a file with...

The Hadoop path parser interprets : as the protocol separator. The solution is to specify the protocol explicitly. If it is a local file:inputFile =...

View Article



Error when trying to load a file with sc.textFile whose name has a colon in it

I use pyspark (Spark 1.0.1) in IPython to load a gzipped TSV file whose names has colons in it. I can load the file fine when I rename it but otherwise I get an error. The commands are:inputFile =...

View Article
Browsing latest articles
Browse All 2 View Live




Latest Images