April 2017 - cctbxbb - phenix-online.org

bootstrap.py on Windows
by Horst Puschmann 20 Jun '17

20 Jun '17

Hello I am trying to install the cctbx on a Windows 7 64 bit machine using the following bootstrap.py file: https://raw.githubusercontent.com/cctbx/cctbx_project/ master/libtbx/auto_build/bootstrap.py The script will fail, unless I comment out lines 1101 and 1102: #if self.isPlatformWindows(): #tarurl, arxname, dirpath = MODULES.get_module(module)().get_tarauthenticated(auth=self.get_auth()) If it tries to execute the commented lines, the error will be "KeyError: 'cciuser' in line 590" After commenting this out, it will fail in line 271, with "AttributeError: 'module' object has no attribute '_create_unverified_context'" I can get round that with disabling line 247: if sys.platform == "win32": (i.e. change this to if sys.platform == "xxx":) After that, things start downloading. All appears well until the same thing happens again in another bootstrap.py file in \modules\cctbx_project\libtbx\auto_build\bootstrap.py If I disable *that*, it goes further, but fails finally with ===== Running in build: run configure.py Traceback (most recent call last): File "bootstrap.py", line 2113, in <module> run() File "bootstrap.py", line 2108, in run enable_shared=options.enable_shared, File "bootstrap.py", line 1036, in run i.run() File "bootstrap.py", line 189, in run raise RuntimeError("Could not run %s: File not found" % executable) RuntimeError: Could not run base\bin\python: File not found I guess the automatic tests haven't picked this up, because no authentication is needed, maybe? Greetings Horst

3 2

Boost Python 1.56
by Luc Bourhis 14 Apr '17

14 Apr '17

Hi, I have improvements to the smtbx on their way to be committed which require Boost version 1.56. This is related to Boost.Threads, whose support I re-activated a few months ago on Nick’s request. I need the function boost::thread::physical_concurrency which returns the number of physical cores on the machine, as opposed to virtual cores when hyperthreading is enabled (which it is by default on any Intel machine). That function is not available in Boost 1.55 which is the version currently used in the nightly tests: it appeared in 1.56. So, would it be possible to move to Boost 1.56? Otherwise, I will need to backport that function. Not too difficult but not thrilling. Best wishes, Luc

14 36

Re: [cctbxbb] [git/cctbx] master: Replacing illegal C++ code with proper dynamic array allocation. (a31eb2bf0)
by Nicholas Sauter 12 Apr '17

12 Apr '17

Rob, Just as a general thing, "new" statements in C++ need to be paired with "delete" statements (delete pk, delete a_sum, and delete akml). Unless this is done there will be a memory leak. Nick Nicholas K. Sauter, Ph. D. Senior Scientist, Molecular Biophysics & Integrated Bioimaging Division Lawrence Berkeley National Laboratory 1 Cyclotron Rd., Bldg. 33R0345 Berkeley, CA 94720 (510) 486-5713 On Tue, Apr 11, 2017 at 3:31 AM, CCTBX Commit via DLS Jenkins < graeme.winter(a)gmail.com> wrote: > Repository : ssh://g18-sc-serv-04.diamond.ac.uk/cctbx > On branch : master > > ------------------------------ > > > commit a31eb2bf0d5bb129425bb759466f45622c773fd4 > Author: Robert Oeffner <rdo20(a)cam.ac.uk> > Date: Tue Apr 11 11:31:24 2017 +0100 > > Replacing illegal C++ code with proper dynamic array allocation. > > > ------------------------------ > > > a31eb2bf0d5bb129425bb759466f45622c773fd4 > scitbx/lbfgs.h | 6 +++--- > 1 file changed, 3 insertions(+), 3 deletions(-) > > diff --git a/scitbx/lbfgs.h b/scitbx/lbfgs.h > index 41be8e8cc..f0000143d 100755 > --- a/scitbx/lbfgs.h > +++ b/scitbx/lbfgs.h > @@ -917,9 +917,9 @@ namespace lbfgs { > int info = 5; > brackt = false; > FloatType sxnorm = std::sqrt(ddot(SizeType(n), sx, sx)); > - FloatType pk[n]; > - FloatType a_sum[n]; > - FloatType akm1[n]; > + FloatType* pk = new FloatType[n]; > + FloatType* a_sum = new FloatType[n]; > + FloatType* akm1 = new FloatType[n]; > for (SizeType i=0; i < n; i++) { > pk[i] = sx[i]/sxnorm; > akm1[i] = -gx[i]/sxnorm; >

3 2

libtiff dependency on macOS
by Billy Poon 11 Apr '17

11 Apr '17

Hi everyone, I just updated install_base_packages.py to build libtiff generally instead of just for Linux. So if you update your sources and get build errors relating to TIFF, please rebuild your base directory. Thanks! -- Billy K. Poon Research Scientist, Molecular Biophysics and Integrated Bioimaging Lawrence Berkeley National Laboratory 1 Cyclotron Road, M/S 33R0345 Berkeley, CA 94720 Tel: (510) 486-5709 Fax: (510) 486-5909 Web: https://phenix-online.org

1 0

Re: [cctbxbb] bug fix in cctbx_project/scitbx/lbfgs.h
by R.D. Oeffner 11 Apr '17

11 Apr '17

There is now a fatal warning in libtbx/SConscript if gcc encounters variable length arrays as this is not portable code and we've had broken builds on more than one occasion due to this recently. Rob On 11/04/2017 12:01, Pavel Afonine wrote: > Hi Rob, > > thanks for the fix. This is was Min's code (remember her from the past workshop?). I simply applied her patch without looking into it too much, and made sure all t96 pass. > > Again, thanks for fixing it. > > Pavel > > On 4/11/17 03:48, R.D. Oeffner wrote: > >> Hi Pavel, I have made a change to that file as it didn't compile on Windows. In fact I can't understand how it would compile with other compilers before as the syntax to me seemed illegal given that n is not known at compile time. I'm not sure how a dynamically created FloatType should be destroyed as I couldn't find any examples of that being done throughout this file. Rob

2 1

bootstrap.py on windows
by Horst Puschmann 07 Apr '17

07 Apr '17

Hello I am trying to install the cctbx on a Windows 7 64 bit machine using the following bootstrap.py file: https://raw.githubusercontent.com/cctbx/cctbx_project/master /libtbx/auto_build/bootstrap.py The script will fail, unless I comment out lines 1101 and 1102: #if self.isPlatformWindows(): #tarurl, arxname, dirpath = MODULES.get_module(module)(). get_tarauthenticated(auth=self.get_auth()) If it tries to execute the commented lines, the error will be "KeyError: 'cciuser' in line 590" After commenting this out, it will fail in line 271, with "AttributeError: 'module' object has no attribute '_create_unverified_context'" I can get round that with disabling line 247: if sys.platform == "win32": (i.e. change this to if sys.platform == "xxx":) After that, things start downloading. All appears well until the same thing happens again in another bootstrap.py file in \modules\cctbx_project\ libtbx\auto_build\bootstrap.py If I disable *that*, it goes further but fails finally with ===== Running in build: run configure.py Traceback (most recent call last): File "bootstrap.py", line 2113, in <module> run() File "bootstrap.py", line 2108, in run enable_shared=options.enable_shared, File "bootstrap.py", line 1036, in run i.run() File "bootstrap.py", line 189, in run raise RuntimeError("Could not run %s: File not found" % executable) RuntimeError: Could not run base\bin\python: File not found I guess the automatic tests haven't picked this up, because no authentication is needed, maybe? Greetings Horst

6 16

Fw: cctbx developer guidelines
by R. D. Oeffner 06 Apr '17

06 Apr '17

Hi Pavel and others, Attached is the original word document you sent out if that's useful for anyone. Rob -----Original Message----- From: Pavel Afonine Sent: Saturday, July 11, 2015 7:12 PM To: Paul Adams ; developers(a)phenix-online.org Subject: Re: cctbx developer guidelines Hi Paul, looks great! Attached is slightly edited copy. Pavel On 7/10/15 11:14, Paul Adams wrote: > Hi Everyone, > > we have developed a cctbx developer guidance document (much of which > also applies to Phenix development). I’m attaching it for your review and > comments. If you have any suggestions let me know. The goal is to > distribute this to all developers who are contributing to the cctbx and to > put it somewhere prominent on the web. > > Cheers, > Paul >

1 0

bootstrap.py not overwriting modified sources
by R.D. Oeffner 01 Apr '17

01 Apr '17

Hi all, It appears that when bootstrap.py is invoked to update sources then unsurprisingly it doesn't overwrite existing sources if these are more recent, as in someone has modified them and not committed the changes. Occasionally this leads to broken builds. To prevent this from happening would it not be a good idea to change bootstrap.py to default to overwrite any uncommitted changes unless some flag is set on the command line? Rob -- Robert Oeffner, Ph.D. Research Associate, The Read Group Department of Haematology, Cambridge Institute for Medical Research University of Cambridge Cambridge Biomedical Campus Wellcome Trust/MRC Building Hills Road Cambridge CB2 0XY www.cimr.cam.ac.uk/investigators/read/index.html tel: +44(0)1223 763234 mobile: +44(0)7712 887162

4 5