nightlies are failing (scala-release-main failing)

[SethTisue]

release-main fails because release-smoketest fails; https://scala-ci.typesafe.com/job/scala-2.11.x-release-smoketest/ shows failures starting Dec 16 or 17 (the run on Dec 16 wedged and had to be aborted, not sure if for same cause or different cause)

perhaps it has to do with scala/scala-dist#154 being merged?

[SethTisue]

smoketest fails because the contents of the tarball are radically wrong. there should be top-level bin, doc, man, and lib directories, but instead there is only a single api directory.

[SethTisue]

it seems there was a regression where the docs archive used to be called e.g. scala-docs-2.11.7.zip but now it's being generated as e.g. scala-2.11.7.zip which then overwrites the main archive

testing with sbt -Dproject.version=2.11.7

before scala/scala-dist#154:

> show universal-docs:packageBin
...
[info] /Users/tisue/scala-dist/target/universal-docs/scala-docs-2.11.7.zip

after:

> show universal-docs:packageBin
...
[info] /Users/tisue/scala-dist/target/universal-docs/scala-2.11.7.zip

[SethTisue]

OK so scala/scala-dist#155 fixed it so scala-dist-smoketest is passing, but that uncovered a further failure in release-website-archives, see e.g. https://scala-ci.typesafe.com/job/scala-2.11.x-release-website-archives/248/console

wget tries to retrieve the .deb and fails with ERROR 403: Forbidden, which makes it sound like a permissions problem, but you can attempt to retrieve random paths and get the same error, so I think it's effectively a 404, so perhaps the .deb isn't getting published at all.

let's see what https://scala-ci.typesafe.com/job/scala-2.11.x-release-package-unix/351/console has to say:

[info] Creating debian package: /home/jenkins/workspace/scala-2.11.x-release-package-unix/target/scala_2.11.8-400_all.deb

uh, that seems like the wrong artifact name. whereas if we go back to early December (before the sbt-native-packager upgrade), at e.g. https://scala-ci.typesafe.com/job/scala-2.11.x-release-package-unix/309/console we see

[info] dpkg-deb: building package `scala' in `/home/jenkins/workspace/scala-2.11.x-release-package-unix/target/scala-2.11.8-5e99f82-nightly.deb'.

so this looks pretty simple, we just need to fix the regression in the naming

at the same time, I should check the names of the rest of the files too, seeing as how two of them have already been found to be wrong

[SethTisue]

at the same time, I should check the names of the rest of the files too, seeing as how two of them have already been found to be wrong

OK so currently if I do sbt -Dproject.version=2.11.7 and then show s3Upload::mappings on jenkins-worker-ubuntu-publish, I see:

List((/home/jenkins/workspace/scala-2.11.x-release-package-unix/target/universal/scala-2.11.7.zip,scala/2.11.7/scala-2.11.7.zip), (/home/jenkins/workspace/scala-2.11.x-release-package-unix/target/universal/scala-2.11.7.tgz,scala/2.11.7/scala-2.11.7.tgz), (/home/jenkins/workspace/scala-2.11.x-release-package-unix/target/universal-docs/scala-docs-2.11.7.zip,scala/2.11.7/scala-docs-2.11.7.zip), (/home/jenkins/workspace/scala-2.11.x-release-package-unix/target/universal-docs/scala-docs-2.11.7.tgz,scala/2.11.7/scala-docs-2.11.7.tgz), (/home/jenkins/workspace/scala-2.11.x-release-package-unix/target/universal-docs/scala-docs-2.11.7.txz,scala/2.11.7/scala-docs-2.11.7.txz), (/home/jenkins/workspace/scala-2.11.x-release-package-unix/target/scala-2.11.7.rpm,scala/2.11.7/scala-2.11.7.rpm), (/home/jenkins/workspace/scala-2.11.x-release-package-unix/target/scala_2.11.7-400_all.deb,scala/2.11.7/scala_2.11.7-400_all.deb))

this all looks fine except for the .deb, which should be scala-2.11.7.deb (or for a nightly, e.g. scala-2.11.8-5e99f82-nightly.deb)

[SethTisue]

ok so in sbt-native-packager 0.6.x the name of the .deb was determined by:

file(tdir.getAbsolutePath + ".deb")

where tdir is target so this hack worked for us to control the deb name:

target in Debian := target.value / s"${(name in Debian).value}-${version.value}"

whereas in 1.0.x the name of the .deb is hardcoded as:

  private[debian] def archiveFilename(appName: String, version: String, arch: String): String = {
    appName + "_" + version + "_" + arch + ".deb"
  }

with no possibility for override that I can see.

so it looks like we'll need to accept that this will be the name on disk, and correct the name at upload time by customizing uploadMappings

[SethTisue]

merged fix for debian issue. new test run: https://scala-ci.typesafe.com/job/scala-2.11.x-release-main/408/

[SethTisue]

appears fixed, but I'll stay on the alert.

[SethTisue]

recent nightlies at http://www.scala-lang.org/files/archive/nightly/2.11.x/ look good. I didn't try the .deb, .rpm, or .msi, but I did unpack http://www.scala-lang.org/files/archive/nightly/2.11.x/scala-2.11.8-f6bd712-nightly.tgz and sanity checked the recursive diffs against 2.11.7