spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From Alessandro Baretta <>
Subject Re: Still struggling with building documentation
Date Tue, 11 Nov 2014 18:50:49 GMT
Nichols and Patrick,

Thanks for your help, but, no, it still does not work. The latest master
produces the following scaladoc errors:

not found: type Type
[error]   protected Type type() { return Type.UPLOAD_BLOCK; }
[error]             ^
not found: type Type
[error]   protected Type type() { return Type.STREAM_HANDLE; }
[error]             ^
not found: type Type
[error]   protected Type type() { return Type.OPEN_BLOCKS; }
[error]             ^
not found: type Type
[error]   protected Type type() { return Type.REGISTER_EXECUTOR; }
[error]             ^


[error] four errors found
[error] (spark/javaunidoc:doc) javadoc returned nonzero exit code
[error] (spark/scalaunidoc:doc) Scaladoc generation failed
[error] Total time: 140 s, completed Nov 11, 2014 10:20:53 AM
Moving back into docs dir.
Making directory api/scala
cp -r ../target/scala-2.10/unidoc/. api/scala
Making directory api/java
cp -r ../target/javaunidoc/. api/java
Moving to python/docs directory and building sphinx.
Makefile:14: *** The 'sphinx-build' command was not found. Make sure you
have Sphinx installed, then set the SPHINXBUILD environment variable to
point to the full path of the 'sphinx-build' executable. Alternatively you
can add the directory with the executable to your PATH. If you don't have
Sphinx installed, grab it from  Stop.

Moving back into home dir.
Making directory api/python
cp -r python/docs/_build/html/. docs/api/python
/usr/lib/ruby/1.9.1/fileutils.rb:1515:in `stat': No such file or directory
- python/docs/_build/html/. (Errno::ENOENT)
from /usr/lib/ruby/1.9.1/fileutils.rb:1515:in `block in fu_each_src_dest'
from /usr/lib/ruby/1.9.1/fileutils.rb:1529:in `fu_each_src_dest0'
from /usr/lib/ruby/1.9.1/fileutils.rb:1513:in `fu_each_src_dest'
from /usr/lib/ruby/1.9.1/fileutils.rb:436:in `cp_r'
from /home/alex/git/spark/docs/_plugins/copy_api_dirs.rb:79:in `<top
from /usr/lib/ruby/1.9.1/rubygems/custom_require.rb:36:in `require'
from /usr/lib/ruby/1.9.1/rubygems/custom_require.rb:36:in `require'
from /usr/lib/ruby/vendor_ruby/jekyll/site.rb:76:in `block in setup'
from /usr/lib/ruby/vendor_ruby/jekyll/site.rb:75:in `each'
from /usr/lib/ruby/vendor_ruby/jekyll/site.rb:75:in `setup'
from /usr/lib/ruby/vendor_ruby/jekyll/site.rb:30:in `initialize'
from /usr/bin/jekyll:224:in `new'
from /usr/bin/jekyll:224:in `<main>'

What next?


On Fri, Nov 7, 2014 at 12:54 PM, Nicholas Chammas <> wrote:

> I believe the web docs need to be built separately according to the
> instructions here
> <>.
> Did you give those a shot?
> It's annoying to have a separate thing with new dependencies in order to
> build the web docs, but that's how it is at the moment.
> Nick
> On Fri, Nov 7, 2014 at 3:39 PM, Alessandro Baretta <>
> wrote:
>> I finally came to realize that there is a special maven target to build
>> the scaladocs, although arguably a very unintuitive on: mvn verify. So now
>> I have scaladocs for each package, but not for the whole spark project.
>> Specifically, build/docs/api/scala/index.html is missing. Indeed the whole
>> build/docs/api directory referenced in api.html is missing. How do I build
>> it?
>> Alex Baretta

View raw message