- cctbxbb - phenix-online.org

Re: [cctbxbb] error
by markus.gerstel＠diamond.ac.uk 23 Jun '16

23 Jun '16

Hi James, CCing cctbxbb for further support I can reproduce at least similar errors with both DIALS 1.2.5 and current nightly builds. I think this may be a matplotlib 1.3.1 problem. A minimal reproducer is: $ dials.python > import matplotlib.pyplot as plt > plt.imshow([[1]]) Gtk-Message... > (press ctrl+D) Segmentation fault When compiled on the same machine I do not get the Gtk-Messages, but I do get the segmentation fault. Markus Gerstel MBCS Postdoctoral Research Associate Tel: +44 1235 778698 Diamond Light Source Ltd. Diamond House Harwell Science & Innovation Campus Didcot Oxfordshire OX11 0DE From: Parkhurst, James (DLSLtd,RAL,LSCI) Sent: 21 June 2016 16:58 To: Gerstel, Markus (DLSLtd,RAL,LSCI) Subject: FW: error Hi Markus, I've been getting my summer student to do the cctbx_introduction tutorials in dials_scratch. He's using a version of dials downloaded from the website and when he runs the introduction script he gets errors about gdk-pixbuf giving paths to /scratch/jenkins_slave/workspace/. This seems like there is a jenkins path being set in the distributed installers. Would you have any idea how I can fix this? I'm downloading the linux installer of DIALS now so I can test this myself. Thanks, James ________________________________ [sse87232@ws188 cctbx_introduction_1]$ dials.python cctbx_introduction_1_test.py ximg2701_00001.cbf (cctbx_introduction_1_test.py:6243): GdkPixbuf-WARNING **: Cannot open pixbuf loader module file '/scratch/jenkins_slave/workspace/dials_release_build/compilationtarget/native/label/dials-ws133/build_dials/base/etc/gtk-2.0/gdk-pixbuf.loaders': No such file or directory (cctbx_introduction_1_test.py:6243): GdkPixbuf-WARNING **: Cannot open pixbuf loader module file '/scratch/jenkins_slave/workspace/dials_release_build/compilationtarget/native/label/dials-ws133/build_dials/base/etc/gtk-2.0/gdk-pixbuf.loaders': No such file or directory (cctbx_introduction_1_test.py:6243): GdkPixbuf-WARNING **: Cannot open pixbuf loader module file '/scratch/jenkins_slave/workspace/dials_release_build/compilationtarget/native/label/dials-ws133/build_dials/base/etc/gtk-2.0/gdk-pixbuf.loaders': No such file or directory (cctbx_introduction_1_test.py:6243): GdkPixbuf-WARNING **: Cannot open pixbuf loader module file '/scratch/jenkins_slave/workspace/dials_release_build/compilationtarget/native/label/dials-ws133/build_dials/base/etc/gtk-2.0/gdk-pixbuf.loaders': No such file or directory (cctbx_introduction_1_test.py:6243): GdkPixbuf-WARNING **: Cannot open pixbuf loader module file '/scratch/jenkins_slave/workspace/dials_release_build/compilationtarget/native/label/dials-ws133/build_dials/base/etc/gtk-2.0/gdk-pixbuf.loaders': No such file or directory (cctbx_introduction_1_test.py:6243): GdkPixbuf-WARNING **: Cannot open pixbuf loader module file '/scratch/jenkins_slave/workspace/dials_release_build/compilationtarget/native/label/dials-ws133/build_dials/base/etc/gtk-2.0/gdk-pixbuf.loaders': No such file or directory (cctbx_introduction_1_test.py:6243): GdkPixbuf-WARNING **: Cannot open pixbuf loader module file '/scratch/jenkins_slave/workspace/dials_release_build/compilationtarget/native/label/dials-ws133/build_dials/base/etc/gtk-2.0/gdk-pixbuf.loaders': No such file or directory Segmentation fault (core dumped) [sse87232@ws188 cctbx_introduction_1]$ which dials.python /dls/science/users/sse87232/dials/dials-v1-2-4/build/bin/dials.python -- This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail. Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd. Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message. Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom

4 6

past contributors
by markus.gerstel＠diamond.ac.uk 16 Jun '16

16 Jun '16

I have now contacted everyone who ever contributed to cctbx in the past to get name/email details in preparation for an svn->git conversion. Everyone except these three: Erik McKee (emckee) Vishal Verma (vermav) ydr (y0udar) Anyone know how to get into contact with them? -Markus -- This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail. Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd. Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message. Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom

2 1

Not wishing to raise this again but...
by Graeme.Winter＠diamond.ac.uk 16 Jun '16

16 Jun '16

... is there any enthusiasm out there for moving cctbx to git? The more I work with git the more I wish this existed properly for cctbx. I've raised this a bunch of times and always it is "not right now" however "a good idea" - this'll be the last time I ask... Could we move to git, please? I note the bootstrap script for Windows now has a git dependency even! Am happy to help if I can with anything though I think it should be pretty simple... was for DIALS & xia2 :) Thanks Graeme -- This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail. Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd. Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message. Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom

8 23

Not wishing to raise this again but...
by R.D. Oeffner 15 Jun '16

15 Jun '16

Personally I think moving the cctbx to git is a great idea as it would make it easier and safer when developing and testing new features. Given so many teams are using the cctbx this seems like a compelling reason for it to be moved. We had a chat a while ago with Berkeley about this but I've forgotten what the consensus was. Rob > > Message: 1 > Date: Tue, 14 Jun 2016 12:10:03 +0000 > From: <Graeme.Winter(a)diamond.ac.uk> > To: <cctbxbb(a)phenix-online.org> > Subject: Re: [cctbxbb] Not wishing to raise this again but... > Message-ID: <13999B6FC038EB44B067771E3CFBD091BC327D8E@exchmbx03> > Content-Type: text/plain; charset="us-ascii" > > Hi All, > > This sounds like it is heading in a pragmatic direction - I would find > it very helpful to gauge feeling for or against this. To make this > simple I have attempted (starting from a completely ignorant position) > to put together one of those online survey things: > > https://www.surveymonkey.co.uk/r/GXPY5JW > > If you could pick an option that would be great, explaining why would > be even better, or hitting reply-all to this thread would also work > (as has previously done so) I'll collate answers over the next few > days & feed back when we have (say) 10-20 or a few days have passed > >> From experience with moving xia2 & DIALS it was surprisingly >> straightforward (an opinion) > > Thanks & cheerio Graeme > > -----Original Message----- > From: cctbxbb-bounces(a)phenix-online.org > [mailto:[email protected]] On Behalf Of > markus.gerstel(a)diamond.ac.uk > Sent: 14 June 2016 12:18 > To: cctbxbb(a)phenix-online.org > Subject: Re: [cctbxbb] Not wishing to raise this again but... > > Hi Pavel, > > I volunteered to do this some time ago, just like for DIALS, and would > still be happy to do this. > We can do the move slowly, so allow users (developers) with a git > repository while development still happens in SVN for say a couple of > weeks, and I would be happy to run the git support for that time and > for the aftermath of the move. > > Best wishes > -Markus > > -----Original Message----- > From: cctbxbb-bounces(a)phenix-online.org > [mailto:[email protected]] On Behalf Of Pavel Afonine > Sent: 14 June 2016 12:11 > To: cctbx mailing list > Subject: Re: [cctbxbb] Not wishing to raise this again but... > > Hey there! > > Well I guess I say something even though I don't have much to say > really. I've been contributing to CCTBX for the past 13 years, so I > feel like this conversation is not too irrelevant to me to say the > least. > > I don't have strong opinion about staying with svn vs moving to git. I > routinely contribute to CCTBX (which is SVN-based) and I routinely > contribute to my other activity - Q|R (Quantum Refinement, which is > hosted by GitHub). I'm comfortable with both environments as I'm using > only the minimal functionality of both: check in, check out, diff.. > period. I'm not interested in branching/etc sophistication; this is > just because the way I structure my workflow.. > > My current understanding is that moving CCTBX to use git boils down to: > - actually someone doing it; AND > - taking good proper responsible care of the aftermath (if any). > > So far no-one volunteered to embrace this challenge, as far as I know. > > In summary I think we should move to git, at least to follow the > vector of progress. > > All the best, > Pavel >

3 2

bootstrap.py build on Ubuntu
by David Waterman 14 Jun '16

14 Jun '16

Hi folks I recently tried building cctbx+dials on Ubuntu 15.04 following the instructions here: http://dials.github.io/documentation/installation_developer.html This failed during installation of pango-1.16.1. Looking at pango_install_log, I see the command that failed was as follows: gcc -DHAVE_CONFIG_H -I. -I. -I../.. -DSYSCONFDIR=\"/home/fcx32934/sw/dials_bootstrap_test/base/etc\" -DLIBDIR=\"/home/fcx32934/sw/dials_bootstrap_test/base/lib\" -DG_DISABLE_CAST_CHECKS -I../.. -DG_DISABLE_DEPRECATED -I/home/fcx32934/sw/dials_bootstrap_test/base/include -I/home/fcx32934/sw/dials_bootstrap_test/base/include/freetype2 -g -O2 -Wall -MT fribidi.lo -MD -MP -MF .deps/fribidi.Tpo -c fribidi.c -fPIC -DPIC -o .libs/fribidi.o In file included from fribidi.h:31:0, from fribidi.c:28: fribidi_config.h:1:18: fatal error: glib.h: No such file or directory The file glib.h appears to be in base/include/glib-2.0/, however this directory was not explicitly included in the command above, only its parent. This suggests a configuration failure in pango to me. Taking a look at base_tmp/pango-1.16.1/config.log, I see what look like the relevant lines: configure:22227: checking for GLIB configure:22235: $PKG_CONFIG --exists --print-errors "$GLIB_MODULES" configure:22238: $? = 0 configure:22253: $PKG_CONFIG --exists --print-errors "$GLIB_MODULES" configure:22256: $? = 0 configure:22304: result: yes but this doesn't tell me very much. Does anyone have any suggestions as to how I might proceed? Many thanks -- David

3 10

Nightly test server down?
by Luc Bourhis 14 Jun '16

14 Jun '16

Hi, http://cci-vm-6.lbl.gov:8010/waterfall does not answer anymore from where I stand (Paris). Best wishes, Luc

3 2

flex.histogram: add weights?
by Graeme.Winter＠diamond.ac.uk 14 Jun '16

14 Jun '16

Hi Folks I would like to be able to compute a weighted flex histogram i.e. instead of adding 1 for every element in array add weight[i] for array[i] instead (ie. generalized) Has anyone done this already? Don't want to break anything, will require the histogram itself being non-integral... Thanks Graeme -- This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail. Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd. Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message. Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom

3 3

Project Scientist positions for computational methods
by Nicholas Sauter 13 Jun '16

13 Jun '16

Two Project Scientist positions are available in my group in the *Molecular Biophysics and Integrated Bioimaging* <http://biosciences.lbl.gov/divisions/mbib/> (MBIB) Division at Lawrence Berkeley National Lab. *Bioimaging Project Scientist* Position Summary: We have an exciting opportunity for a Bioimaging Project Scientist who will apply neuromorphic computing techniques to structural biology problems in X-ray diffraction, CryoEM, and CryoET. This will be a cross-disciplinary effort between MBIB and the Computational Research (CRD) Division at Lawrence Berkeley National Laboratory. The research group will include investigators Nick Sauter (X-ray Crystallography), Karen Davies (CryoEM/ET), and Chao Yang (Scalable Solvers). Specific Responsibilities: - Investigate how to apply deep learning algorithms to specific data processing and data interpretation problems in structural biology. - Implement convolutional neural network (CNN) code on neuromorphic computing hardware such as the IBM TrueNorth chip. Example problems include the identification of positive diffraction events in X-ray free-electron laser diffraction, conformational classification in CryoEM single particle reconstruction, and the identification of 3D sections for CryoET subtomogram averaging. - Use tools such as MatConvNet, CAFFE, THEANO or TensorFlow to construct and train CNNs that can be used to optimally classify experimental data. Required Qualifications: - Research experience in Structural Biology, with expertise in allied fields such as Bioinformatics, Mathematics, Computer Science, or Engineering (Ph.D. + 3 years or equivalent) - Strong background in image analysis and machine learning, including neural networks. - Working knowledge of image classification and/or other image processing techniques. - Proficient programming skills in MATLAB and/or Python. - Working knowledge of performance optimization for scientific codes. *Algorithm Developer Project Scientist* Position Summary: We are seeking an algorithm developer for the increasingly complex analysis of large diffraction datasets in structural biology. Current projects utilize XFEL crystallography and spectroscopy to investigate the photosynthetic mechanism of water splitting and to probe other metalloenzyme reactions. We also wish to test whether diffuse scattering can reveal correlated atomic motions in crystals. Many problems remain to be solved, including the details of how to optimally merge datasets from thousands of crystals. Our software development projects (including packages such as DIALS <http://dials.lbl.gov/> and cctbx.xfel <http://cci.lbl.gov/xfel>) have been highlighted in several high-impact publications listed HERE <http://biosciences.lbl.gov/profiles/nicholas-sauter>. Specific Responsibilities: - Continue work on the DIALS data integration suite. - Test new algorithms for optimally characterizing and merging data from serial crystallography experiments. - Analyze anomalous scattering from metalloenzymes using XFEL diffraction. - Investigate whether diffuse scattering can reveal correlated atomic motions in crystals. Required Qualifications: - Expertise in one or more computational techniques including, but not limited to, ray tracing to test underlying physical models of the diffraction, Bayesian approaches for refining model parameters, macromolecular modeling and refinement, neural networks for interpreting image features, as well as signal processing and denoising methods. - Extensive data analysis experience in crystallography or from more general bioimaging backgrounds are welcome. - We particularly encourage strong mathematical intuition and a track record of bringing new ideas and tools to fruition, as evidenced through written publication and clear presentation. Candidates should send an expression of interest, CV, and list of three references to Nick Sauter, nksauter(a)lbl.gov*. *Further details are posted at https://lbl.taleo.net/careersection/2/jobdetail.ftl?lang=en&job=82554. Nicholas K. Sauter, Ph. D. Computer Staff Scientist, Molecular Biophysics and Integrated Bioimaging Division Lawrence Berkeley National Laboratory 1 Cyclotron Rd., Bldg. 33R0345 Berkeley, CA 94720

1 0

Not wishing to raise this again but...
by R. D. Oeffner 13 Jun '16

13 Jun '16

Switching to git for the cctbx would be very liberating for developing and testing code I believe. If bisecting git hash values seems cumbersome one can always tag each commit with the number of previous commits made to the branch used for the build. These numbers are sequential and obviously straightforward to use for bisecting. We do this currently for the phaser git repo: https://git.csx.cam.ac.uk/x/cimr-phaser/phaser.git Rob Date: Mon, 13 Jun 2016 21:24:58 +0000 From: <richard.gildea(a)diamond.ac.uk> To: <cctbxbb(a)phenix-online.org> Subject: Re: [cctbxbb] Not wishing to raise this again but... Message-ID: <1BB183A24316FD4DA62A5F8B952D4291CC715321@exchmbx03> Content-Type: text/plain; charset="windows-1252" At least according to Google Trends, svn has been on a downward trend since about 2009/10, whereas git is still firmly on an upward trend (and overtook svn in popularity long ago): <https://www.google.co.uk/trends/explore#q=git%20commit%2C%20svn%20commit&cm…> https://www.google.co.uk/trends/explore#q=git%20commit%2C%20svn%20commit&cm… <https://www.google.co.uk/trends/explore#q=git%20commit%2C%20svn%20commit&cm…><https://www.google.co.uk/trends/explore#q=git%20commit%2C%20svn%20commit&cm…><https://www.google.co.uk/trends/explore#q=git%20commit%2C%20svn%20commit&cm…> [cid:162fa876-cc25-6335-73af-714b0957d71e] I think that avoiding a move to git is simply delaying the inevitable (and if the cctbx didn't ever move with the times then we'd still be stuck with CVS). In my opinion, the potential benefits to using git far outweigh the (slightly) added complexity. <https://www.google.co.uk/trends/explore#q=git%20commit%2C%20svn%20commit&cm…><https://www.google.co.uk/trends/explore#q=git%20commit%2C%20svn%20commit&cm…>Cheers, Richard ________________________________ From: cctbxbb-bounces(a)phenix-online.org [cctbxbb-bounces(a)phenix-online.org] on behalf of Nicholas Sauter [nksauter(a)lbl.gov] Sent: 13 June 2016 22:05 To: cctbx mailing list Subject: Re: [cctbxbb] Not wishing to raise this again but... I'd vote against the switch to git. Simple things, like svn update [remote directory] seem too complicated. As for slightly involved tasks like code bisection to locate the past commit that broke the test, well....I've never been able to figure this one out so I am pretty lost trying to debug DIALS. I do not wish to make things difficult for the maintenance of cctbx.xfel. Nick Nicholas K. Sauter, Ph. D. Computer Staff Scientist, Molecular Biophysics and Integrated Bioimaging Division Lawrence Berkeley National Laboratory 1 Cyclotron Rd., Bldg. 33R0345 Berkeley, CA 94720 (510) 486-5713 On Mon, Jun 13, 2016 at 8:52 AM, Luc Bourhis <luc_j_bourhis(a)mac.com<mailto:[email protected]>> wrote: On 13 Jun 2016, at 17:09, Graeme.Winter(a)Diamond.ac.uk<mailto:[email protected]> wrote: ? is there any enthusiasm out there for moving cctbx to git? The more I work with git the more I wish this existed properly for cctbx. I?ve raised this a bunch of times and always it is ?not right now? however ?a good idea? ? this?ll be the last time I ask? Could we move to git, please? I note the bootstrap script for Windows now has a git dependency even! +1 ? and time to share some thoughts! It would be great if we could get the cctbx up and running by just cloning, configuring and building without needing to download anything else. That could be done by adding SCons, Boost, and ccp4io as submodules in the cctbx repository. And I reckon ccp4io_adaptbx should be added as a subtree since it is developed by the same people as the cctbx. Just an idea to think about as I haven?t not worked out the details at all. Best wishes, Luc _______________________________________________ cctbxbb mailing list cctbxbb(a)phenix-online.org<mailto:[email protected]> http://phenix-online.org/mailman/listinfo/cctbxbb -- This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail. Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd. Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message. Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom

1 0

XQuartz 2.7.9 issue for OS X
by Billy Poon 11 Jun '16

11 Jun '16

Hi all, There seems to be an issue with XQuartz 2.7.9 on OS X when trying to render an OpenGL window (e.g. Coot, PyMOL, Phenix GLViewer) over SSH using X forwarding (i.e. ssh -Y). You will get an error that looks like X Error of failed request: BadValue (integer parameter out of range for operation) Major opcode of failed request: 150 (GLX) Minor opcode of failed request: 3 (X_GLXCreateContext) It seems like indirect rendering of a GLX context does not work properly on 2.7.9. Downgrading to XQuartz 2.7.8 works for me. -- Billy K. Poon Research Scientist, Molecular Biophysics and Integrated Bioimaging Lawrence Berkeley National Laboratory 1 Cyclotron Road, M/S 33R0345 Berkeley, CA 94720 Tel: (510) 486-5709 Fax: (510) 486-5909 Web: https://phenix-online.org

1 0