Build #256

Environment variables

NameValue
ANDROID_HOME/home/android-sdk/
BUILD_CAUSEUPSTREAMTRIGGER
BUILD_CAUSE_UPSTREAMTRIGGERtrue
BUILD_DISPLAY_NAME#256
BUILD_ID256
BUILD_NUMBER256
CLASSPATH$CLASSPATH
EXECUTOR_NUMBER10
GIT_BRANCHsambamba-markdup
HADOOP_VERSION2.7.5
HOME/home/jenkins
HUDSON_HOME/var/lib/jenkins
HUDSON_SERVER_COOKIE472906e9832aeb79
HUDSON_URLhttps://amplab.cs.berkeley.edu/jenkins/
JAVA_HOME/usr/java/latest
JENKINS_HOME/var/lib/jenkins
JENKINS_SERVER_COOKIE472906e9832aeb79
JENKINS_URLhttps://amplab.cs.berkeley.edu/jenkins/
LANGen_US.UTF-8
LOGNAMEjenkins
MOTD_SHOWNpam
NODE_LABELSresearch-jenkins-worker-03 ubuntu
NODE_NAMEresearch-jenkins-worker-03
OLDPWD/home/jenkins
PATH/home/jenkins/tools/hudson.tasks.Maven_MavenInstallation/Maven_3.6.3/bin/:/home/jenkins/gems/bin:/usr/local/go/bin:/home/jenkins/go-projects/bin:/home/jenkins/anaconda2/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin
PWD/home/jenkins
ROOT_BUILD_CAUSEGHPRBCAUSE
ROOT_BUILD_CAUSE_GHPRBCAUSEtrue
SCALA_VERSION2.12
SHELL/bin/bash
SHLVL0
SPARK_VERSION2.4.7
SSH_CLIENT192.168.10.10 52600 22
SSH_CONNECTION192.168.10.10 52600 192.168.10.23 22
USERjenkins
XDG_RUNTIME_DIR/run/user/1001
XDG_SESSION_CLASSuser
XDG_SESSION_ID146
XDG_SESSION_TYPEtty
_/usr/java/latest/bin/java
ghprbActualCommit734ed70a5caf8190091341886a69147ddfdbffa9
ghprbActualCommitAuthorMichael L Heuer
ghprbActualCommitAuthorEmailheuermh@acm.org
ghprbAuthorRepoGitUrlhttps://github.com/heuermh/cannoli.git
ghprbCommentBodynull
ghprbCredentialsIdb7d94526-9e9b-435f-9275-d7dbf209f4a3
ghprbGhRepositorybigdatagenomics/cannoli
ghprbPullAuthorLoginheuermh
ghprbPullAuthorLoginMention@heuermh
ghprbPullDescriptionGitHub pull request #203 of commit 734ed70a5caf8190091341886a69147ddfdbffa9, no merge conflicts.
ghprbPullId203
ghprbPullLinkhttps://github.com/bigdatagenomics/cannoli/pull/203
ghprbPullLongDescriptionWork in progress, not working\r\n```\r\n$ ./bin/cannoli-submit sambambaMarkdup \\r\n  NA12878.alignedHg38.duplicateMarked.baseRealigned.bam \\r\n  NA12878.alignedHg38.duplicateMarked.baseRealigned.markdup.alignments.adam\r\n\r\n...\r\n19/10/04 11:45:49 INFO SambambaMarkdup: Piping RDDBoundAlignmentRecordDataset\r\nwith 3366 reference sequences, 3 read groups, and 3 processing steps to sambamba\r\nwith command: [sambamba, markdup, /dev/stdin, /dev/stdout] files: []\r\n...\r\n19/10/04 11:46:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms\r\n\r\nsambamba 0.6.8 by Artem Tarasov and Pjotr Prins (C) 2012-2018\r\n    LDC 1.11.0 / DMD v2.081.2 / LLVM6.0.1 / bootstrap LDC - the LLVM D compiler (0.17.6)\r\n\r\nfinding positions of the duplicate reads in the file...\r\n  sorted 0 end pairs\r\n     and 0 single ends (among them 0 unmatched pairs)\r\n  collecting indices of duplicate reads...   done in 0 ms\r\n  found 0 duplicates\r\ncollected list of positions in 0 min 0 sec\r\nsambamba-markdup: not enough data in stream\r\n```\r\n\r\nSimilar issues when calling directly\r\n```\r\n$ cat NA12878.alignedHg38.duplicateMarked.baseRealigned.bam \\r\n  | sambamba markdup /dev/stdin /dev/stdout \\r\n  > NA12878.alignedHg38.duplicateMarked.baseRealigned.markdup.bam\r\n\r\nsambamba 0.6.8 by Artem Tarasov and Pjotr Prins (C) 2012-2018\r\n    LDC 1.11.0 / DMD v2.081.2 / LLVM6.0.1 / bootstrap LDC - the LLVM D compiler (0.17.6)\r\n\r\nfinding positions of the duplicate reads in the file...\r\n  sorted 29356 end pairs\r\n     and 423 single ends (among them 0 unmatched pairs)\r\n  collecting indices of duplicate reads...   done in 5 ms\r\n  found 48 duplicates\r\ncollected list of positions in 0 min 0 sec\r\nsambamba-markdup: not enough data in stream\r\n```\r\n\r\nSeems to work ok without `/dev/stdin` and `/dev/stdout`\r\n```\r\n$ sambamba markdup \\r\n  NA12878.alignedHg38.duplicateMarked.baseRealigned.bam \\r\n  NA12878.alignedHg38.duplicateMarked.baseRealigned.markdup.bam\r\n\r\nsambamba 0.6.8 by Artem Tarasov and Pjotr Prins (C) 2012-2018\r\n    LDC 1.11.0 / DMD v2.081.2 / LLVM6.0.1 / bootstrap LDC - the LLVM D compiler (0.17.6)\r\n\r\nfinding positions of the duplicate reads in the file...\r\n  sorted 29356 end pairs\r\n     and 423 single ends (among them 0 unmatched pairs)\r\n  collecting indices of duplicate reads...   done in 4 ms\r\n  found 48 duplicates\r\ncollected list of positions in 0 min 0 sec\r\nmarking duplicates...\r\ncollected list of positions in 0 min 2 sec\r\n```
ghprbPullTitleAdd Sambamba markdup for marking duplicate reads
ghprbSourceBranchsambamba-markdup
ghprbTargetBranchmaster
labelubuntu
sha1origin/pr/203/merge