December 2016 - cctbxbb - phenix-online.org

Boost Python 1.56
by Luc Bourhis 14 Apr '17

14 Apr '17

Hi, I have improvements to the smtbx on their way to be committed which require Boost version 1.56. This is related to Boost.Threads, whose support I re-activated a few months ago on Nick’s request. I need the function boost::thread::physical_concurrency which returns the number of physical cores on the machine, as opposed to virtual cores when hyperthreading is enabled (which it is by default on any Intel machine). That function is not available in Boost 1.55 which is the version currently used in the nightly tests: it appeared in 1.56. So, would it be possible to move to Boost 1.56? Otherwise, I will need to backport that function. Not too difficult but not thrilling. Best wishes, Luc

14 36

easy_mp.multi_core_run function
by R.D. Oeffner 19 Dec '16

19 Dec '16

Hi, I needed a way to do multiprocessing job runs in a simple fashion on a multicore PC. Gabor provided much of the underlying machinery in libtbx for that. But I have often found I'm wasting too much time setting it all up. So I crafted a small function, easy_mp.multi_core_run(), out of his example in Computational Crystallography Newsletter (2013). 4, p21 which does exactly that. Unlike easy_mp.parallel_map() this function continues if one of the jobs crashes catastrophically. It takes as arguments name of function to be parallelised, a list of argument tuples and number of processors to run on. As the jobs completes it returns an iterator of tuples of arguments with corresponding results. Example: def RunMyJob(args1, args2): pass def GatherResults(parmres): pass from libtbx import easy_mp argstuples = [(args1a, args2a), (args1b, args2b), (args1c, args2c) ] for i, parmres in enumerate(easy_mp.multi_core_run( RunMyJob, argstuples, nproc)): GatherResults( parmres ) I'm interested in comments or if this kind of simple function is already available elsewhere. Regards, Rob -- Robert Oeffner, Ph.D. Research Associate, The Read Group Department of Haematology, Cambridge Institute for Medical Research University of Cambridge Cambridge Biomedical Campus Wellcome Trust/MRC Building Hills Road Cambridge CB2 0XY www.cimr.cam.ac.uk/investigators/read/index.html tel: +44(0)1223 763234 mobile: +44(0)7712 887162

1 0

Making branches by accident
by Graeme.Winter＠diamond.ac.uk 19 Dec '16

19 Dec '16

Morning all I am seeing a certain amount of "Merge branch 'master' of github.com:cctbx/cctbx_project" coming through on the commits - this usually means you did not do a git pull -rebase before the git push. This can be set to the default by using the spell Markus sent out git config --global pull.rebase true This will need to be done on each machine you push from, else getting the habit of doing a git pull -rebase before push is a good one. We have had this on and off with DIALS but it tends to pass easily enough. What bad happens? Nothing really but the history becomes confusing... So: may be worth checking that you have the pull.rebase thing set? Cheerio Graeme -- This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail. Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd. Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message. Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom

6 11

Re: [cctbxbb] issue tracker on https://github.com/cctbx/cctbx_project
by markus.gerstel＠diamond.ac.uk 10 Dec '16

10 Dec '16

Hi, Yes, we can do that with the tools we have. (Jenkins + Python + Github API) -Markus On 9 Dec 2016 16:13, Graeme.Winter(a)diamond.ac.uk wrote: Hi Nigel, all That could be harder but not beyond our capabilities I expect However the response seems to be a resounding go for it, so I’m sure the issue tracker will be activated RSN Best wishes Graeme From: cctbxbb-bounces(a)phenix-online.org [mailto:[email protected]] On Behalf Of Nigel Moriarty Sent: 09 December 2016 15:43 To: cctbx mailing list Subject: Re: [cctbxbb] issue tracker on https://github.com/cctbx/cctbx_project One feature that would be cool is to set a (say) weekly email to remind developers of the issues assigned to them. In my other collabs, there is a complaints that the issues are not being noticed... Cheers Nigel --- Nigel W. Moriarty Building 33R0349, Molecular Biophysics and Integrated Bioimaging Lawrence Berkeley National Laboratory Berkeley, CA 94720-8235 Phone : 510-486-5709 Email : NWMoriarty(a)LBL.gov<mailto:[email protected]> Fax : 510-486-5909 Web : CCI.LBL.gov<http://CCI.LBL.gov> On Fri, Dec 9, 2016 at 7:40 AM, Aaron Brewster <asbrewster(a)lbl.gov<mailto:[email protected]>> wrote: Also +1. I like how it's possible to reference issues in commits by using #, which then show up as links in the commit emails and website history. One can cite issue numbers, or even interact with them. For example, if your commit includes the phrase "closes #42" or "fixes #42", then issue 42 will be closed when you push your commit. It's Nifty. -Aaron On Fri, Dec 9, 2016 at 7:29 AM, Nigel Moriarty <nwmoriarty(a)lbl.gov<mailto:[email protected]>> wrote: We at Phenix would like to see how the issue/bug tracker works as it's an important feature we'd like to use when we migrate our other repos to GitHub. Cheers Nigel --- Nigel W. Moriarty Building 33R0349, Molecular Biophysics and Integrated Bioimaging Lawrence Berkeley National Laboratory Berkeley, CA 94720-8235 Phone : 510-486-5709<tel:%28510%29%20486-5709> Email : NWMoriarty(a)LBL.gov<mailto:[email protected]> Fax : 510-486-5909<tel:%28510%29%20486-5909> Web : CCI.LBL.gov<http://CCI.LBL.gov> On Fri, Dec 9, 2016 at 6:23 AM, Luc Bourhis <luc_j_bourhis(a)mac.com<mailto:[email protected]>> wrote: Hi Graeme, Does anyone have an objection to opening up the issue tracker on […] Your thoughts? +1 Best wishes, Luc _______________________________________________ cctbxbb mailing list cctbxbb(a)phenix-online.org<mailto:[email protected]> http://phenix-online.org/mailman/listinfo/cctbxbb _______________________________________________ cctbxbb mailing list cctbxbb(a)phenix-online.org<mailto:[email protected]> http://phenix-online.org/mailman/listinfo/cctbxbb _______________________________________________ cctbxbb mailing list cctbxbb(a)phenix-online.org<mailto:[email protected]> http://phenix-online.org/mailman/listinfo/cctbxbb -- This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail. Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd. Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message. Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom

1 0

issue tracker on https://github.com/cctbx/cctbx_project
by Graeme.Winter＠diamond.ac.uk 10 Dec '16

10 Dec '16

Good afternoon all Does anyone have an objection to opening up the issue tracker on https://github.com/cctbx/cctbx_project at the moment we make a lot of use of issue trackers for dials and xia2, and for cctbx this would be helpful - so we could for example host issues in a more appropriate place like https://github.com/dials/dials/issues/265 which would be more "at home" in cctbx Your thoughts? Thanks & best wishes Graeme -- This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail. Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd. Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message. Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom

4 6