Answer by Daniel Darabos for Error when trying to load a file with...
The Hadoop path parser interprets : as the protocol separator. The solution is to specify the protocol explicitly. If it is a local file:inputFile =...
View ArticleError when trying to load a file with sc.textFile whose name has a colon in it
I use pyspark (Spark 1.0.1) in IPython to load a gzipped TSV file whose names has colons in it. I can load the file fine when I rename it but otherwise I get an error. The commands are:inputFile =...
View Article
More Pages to Explore .....