- cctbxbb - phenix-online.org

Warnings (by the hundredweight)
by Winter, Graeme (DLSLtd,RAL,LSCI) 25 Sep '20

25 Sep '20

Hi Folks Spent this afternoon looking at https://github.com/cctbx/cctbx_project/issues/532 which involves touching C++ header code deep in scitbx - which is fine - but every recompile generates hundreds of warnings from all over the place so your actual compiler errors are completely obscured Massive amounts of deprecation errors everywhere e.g. In file included from /Users/graeme/svn/cctbx/modules/cctbx_project/cctbx/maptbx/asymmetric_map.cpp:5: In file included from /Users/graeme/svn/cctbx/modules/cctbx_project/cctbx/maptbx/asymmetric_map.h:18: In file included from /Users/graeme/svn/cctbx/modules/cctbx_project/cctbx/sgtbx/direct_space_asu/proto/asymmetric_unit.h:6: In file included from /Users/graeme/svn/cctbx/modules/cctbx_project/cctbx/sgtbx/direct_space_asu/proto/direct_space_asu.h:9: /Users/graeme/svn/cctbx/modules/cctbx_project/cctbx/sgtbx/direct_space_asu/proto/facet_collection.h:72:34: warning: 'pointer' is deprecated [-Wdeprecated-declarations] faces_ = facet_collection::pointer(a.faces_->new_copy()); In file included from /Users/graeme/svn/cctbx/modules/cctbx_project/cctbx/sgtbx/direct_space_asu/proto/asymmetric_unit.h:6: In file included from /Users/graeme/svn/cctbx/modules/cctbx_project/cctbx/sgtbx/direct_space_asu/proto/direct_space_asu.h:9: /Users/graeme/svn/cctbx/modules/cctbx_project/cctbx/sgtbx/direct_space_asu/proto/facet_collection.h:78:33: warning: 'pointer' is deprecated [-Wdeprecated-declarations] faces(const facet_collection::pointer &a) : faces_(a->new_copy()) {} ^ /Users/graeme/svn/cctbx/conda_base/bin/../include/c++/v1/memory:2130:28: note: 'auto_ptr<cctbx::sgtbx::asu::facet_collection>' has been explicitly marked deprecated here class _LIBCPP_TEMPLATE_VIS _LIBCPP_DEPRECATED_IN_CXX11 auto_ptr ^ /Users/graeme/svn/cctbx/conda_base/bin/../include/c++/v1/__config:972:39: note: expanded from macro '_LIBCPP_DEPRECATED_IN_CXX11' # define _LIBCPP_DEPRECATED_IN_CXX11 _LIBCPP_DEPRECATED ^ /Users/graeme/svn/cctbx/conda_base/bin/../include/c++/v1/__config:961:48: note: expanded from macro '_LIBCPP_DEPRECATED' # define _LIBCPP_DEPRECATED __attribute__ ((deprecated)) is there any appetite on the list to reduce the number of compiler warnings to make development easier? Thanks Graeme -- This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail. Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd. Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message. Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom

2 1

Re: [cctbxbb] [EXTERNAL] cctbxbb Digest, Vol 138, Issue 2
by Mooers, Blaine H.M. (HSC) 24 Sep '20

24 Sep '20

Hi Billy, I installed cctbx in a new conda env called cctbx37: conda create --name cctbx37 python=3.7 conda activate cctbx37 conda install -c conda-forge cctbx jupyterlab I cannot find libtbx.run_tests_module. I can only find libtbx.run_tests_parallel. Best regards, Blaine Blaine Mooers, Ph.D. Associate Professor Department of Biochemistry and Molecular Biology College of Medicine University of Oklahoma Health Sciences Center S.L. Young Biomedical Research Center (BRC) Rm. 466 975 NE 10th Street, BRC 466 Oklahoma City, OK 73104-5419 ________________________________________ From: cctbxbb-bounces(a)phenix-online.org [cctbxbb-bounces(a)phenix-online.org] on behalf of cctbxbb-request(a)phenix-online.org [cctbxbb-request(a)phenix-online.org] Sent: Wednesday, September 23, 2020 2:00 PM To: cctbxbb(a)phenix-online.org Subject: [EXTERNAL] cctbxbb Digest, Vol 138, Issue 2 Send cctbxbb mailing list submissions to cctbxbb(a)phenix-online.org To subscribe or unsubscribe via the World Wide Web, visit https://urldefense.proofpoint.com/v2/url?u=http-3A__phenix-2Donline.org_mai… or, via email, send a message with subject or body 'help' to cctbxbb-request(a)phenix-online.org You can reach the person managing the list at cctbxbb-owner(a)phenix-online.org When replying, please edit your Subject line so it is more specific than "Re: Contents of cctbxbb digest..." Today's Topics: 1. cctbx now available on conda-forge (Billy Poon) ---------------------------------------------------------------------- Message: 1 Date: Wed, 23 Sep 2020 11:22:03 -0700 From: Billy Poon <BKPoon(a)lbl.gov> To: cctbx mailing list <cctbxbb(a)phenix-online.org>, PHENIX user mailing list <phenixbb(a)phenix-online.org> Subject: [cctbxbb] cctbx now available on conda-forge Message-ID: <CAHmYUcZwVDKZ6v1iuA-nP8AJn1cfp3sNWtiqeo=fcWPq9VbpqQ(a)mail.gmail.com> Content-Type: text/plain; charset="utf-8" Hi everyone, The conda-forge package for cctbx is now available. There are 2 packages, "cctbx-base" includes the base code and "cctbx" which includes "cctbx-base" and adds "wxPython", "PySide2", and "ipython". The commands for installing cctbx into your conda environment are conda install -c conda-forge cctbx or conda install -c conda-forge cctbx-base If you want to use Jupyter Lab, you can now easily do this with conda install -c conda-forge cctbx-base jupyterlab jupyter lab The existing documentation will be updated to reflect the easier installation procedure with conda. After installing the conda package, you can also run some of the tests (in an empty directory) with libtbx.run_tests_module module=libtbx module=cctbx nproc=<nproc> I do know of a few issues that I want to fix in upcoming releases, but please submit issues to https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_cctbx_cctbx… with steps to reproduce the error. Thanks! -- Billy K. Poon Research Scientist, Molecular Biophysics and Integrated Bioimaging Lawrence Berkeley National Laboratory 1 Cyclotron Road, M/S 33R0345 Berkeley, CA 94720 Tel: (510) 486-5709 Fax: (510) 486-5909 Web: https://urldefense.proofpoint.com/v2/url?u=https-3A__phenix-2Donline.org&d=…

2 1

cctbx now available on conda-forge
by Billy Poon 24 Sep '20

24 Sep '20

Hi everyone, The conda-forge package for cctbx is now available. There are 2 packages, "cctbx-base" includes the base code and "cctbx" which includes "cctbx-base" and adds "wxPython", "PySide2", and "ipython". The commands for installing cctbx into your conda environment are conda install -c conda-forge cctbx or conda install -c conda-forge cctbx-base If you want to use Jupyter Lab, you can now easily do this with conda install -c conda-forge cctbx-base jupyterlab jupyter lab The existing documentation will be updated to reflect the easier installation procedure with conda. After installing the conda package, you can also run some of the tests (in an empty directory) with libtbx.run_tests_module module=libtbx module=cctbx nproc=<nproc> I do know of a few issues that I want to fix in upcoming releases, but please submit issues to https://github.com/cctbx/cctbx_project with steps to reproduce the error. Thanks! -- Billy K. Poon Research Scientist, Molecular Biophysics and Integrated Bioimaging Lawrence Berkeley National Laboratory 1 Cyclotron Road, M/S 33R0345 Berkeley, CA 94720 Tel: (510) 486-5709 Fax: (510) 486-5909 Web: https://phenix-online.org

1 0

E value calculation
by Academic Research 04 Sep '20

04 Sep '20

Hello Everyone, I am trying to find how to perform the E value calculation using CCTBX. I am unable to find the method in the documentation. Can someone assist me, please? Regards, AC Research

3 2

Changes to boost_adaptbx and
by Billy Poon 19 Aug '20

19 Aug '20

Hi everyone, Two pull requests were merged today that make some important changes. 1) The boost imports were moved to boost_adaptbx.boost. This avoids claiming the main "boost" namespace. A common piece of code that will need to be changed is import boost.python ext = boost.python.import_ext("your_boost_python_ext") That can be changed to import boost_adaptbx.boost.python as bp ext = bp.import_ext("your_boost_python_ext") Otherwise, a FutureWarning will be raised. More information can be found at https://github.com/cctbx/cctbx_project/issues/458 https://github.com/cctbx/cctbx_project/pull/470 https://github.com/cctbx/cctbx_project/pull/516 2) More dependency repositories were moved from cci.lbl.gov to GitHub. If you use bootstrap.py to build cctbx, you will want to delete annlib, ccp4io_adaptbx, clipper, eigen, gui_resources, tntbx. Using a newly updated bootstrap.py, the copies from GitHub will be used instead. More information can be found at https://github.com/cctbx/cctbx_project/pull/408 Let us know if you have any questions. Thanks! -- Billy K. Poon Research Scientist, Molecular Biophysics and Integrated Bioimaging Lawrence Berkeley National Laboratory 1 Cyclotron Road, M/S 33R0345 Berkeley, CA 94720 Tel: (510) 486-5709 Fax: (510) 486-5909 Web: https://phenix-online.org

1 0

unmerged data as mtz object
by Robert Oeffner 05 Aug '20

05 Aug '20

Hi, Does anybody know how to convert a miller array of unmerged data to an mtz object? For merged data I do something like this: mtzobj = millarr.as_mtz_dataset(column_root_label="I") But if millarr contains multiple observations with the same hkl index. Then the above code fails with the exception cctbx Error: Duplicate entries in miller_indices array. Any suggestions? Many thanks, Rob -- Robert Oeffner, Ph.D. Research Associate, The Read Group Department of Haematology, Cambridge Institute for Medical Research University of Cambridge Cambridge Biomedical Campus The Keith Peters Building Hills Road Cambridge CB2 0XY www.cimr.cam.ac.uk/investigators/read/index.html tel: +44(0)1223 763234 -- This email has been checked for viruses by AVG. https://www.avg.com

4 5

flex.histogram giving ArgumentError when arguments correct
by Winter, Graeme (DLSLtd,RAL,LSCI) 04 Aug '20

04 Aug '20

H = flex.histogram(coords, data_min=0.0, data_max=dim, n_slots=dim) Gives Boost.Python.ArgumentError: Please report this error to dials-support(a)lists.sourceforge.net: Python argument types in histogram.__init__(histogram) did not match C++ signature: __init__(_object*, double, double, double, scitbx::af::shared<long>, unsigned long) __init__(_object*, scitbx::histogram<double, long> other, scitbx::af::const_ref<double, scitbx::af::trivial_accessor> data, double relative_tolerance=0.0001) __init__(_object*, scitbx::af::const_ref<double, scitbx::af::trivial_accessor> data, double data_min, double data_max, unsigned long n_slots=1000, double relative_tolerance=0.0001) __init__(_object*, scitbx::af::const_ref<double, scitbx::af::trivial_accessor> data, unsigned long n_slots=1000) Despite coords being <scitbx_array_family_flex_ext.double object at 0x7fa8d671b5b0> with shape (31294944,) and dim being 18093576 (i.e. integer) and h = flex.histogram(a, data_min=0, data_max=100, n_slots=100) working fine in another context i.e. the calling convention is correct This has so far cost a few hours, so what gives? How can this be holding it wrong? C++ code suggests that the bin types are long so this should be fine Any hints? Thanks Graeme -- This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail. Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd. Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message. Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom

2 5

Python development platform
by Winter, Graeme (DLSLtd,RAL,LSCI) 18 Jul '20

18 Jul '20

Hi Folks, Came up in conversation earlier - what version of Python are people using for their day-to-day development? For what it’s worth I’m currently on a 3.6 base, though wondering about moving to e.g. 3.8 Cheers Graeme -- This e-mail and any attachments may contain confidential, copyright and or privileged material, and are for the use of the intended addressee only. If you are not the intended addressee or an authorised recipient of the addressee please notify us of receipt by returning the e-mail and do not use, copy, retain, distribute or disclose the information in or attached to the e-mail. Any opinions expressed within this e-mail are those of the individual and not necessarily of Diamond Light Source Ltd. Diamond Light Source Ltd. cannot guarantee that this e-mail or any attachments are free from viruses and we cannot accept liability for any damage which you may sustain as a result of software viruses which may be transmitted in or with the message. Diamond Light Source Limited (company no. 4375679). Registered in England and Wales with its registered office at Diamond House, Harwell Science and Innovation Campus, Didcot, Oxfordshire, OX11 0DE, United Kingdom

3 2

How to extract I(+) and I(-) from miller array?
by Mooers, Blaine H.M. (HSC) 10 Jun '20

10 Jun '20

Hi Pavel, Thank you very much for the leads. They were very helpful. I was able to make the desired plot. Best regards, Blaine ________________________________________ From: Pavel Afonine [pafonine(a)lbl.gov] Sent: Tuesday, June 09, 2020 2:07 PM To: Mooers, Blaine H.M. (HSC); cctbx mailing list Subject: [EXTERNAL] Re: [cctbxbb] How to extract I(+) and I(-) from miller array? Hi Blaine, this is correct, this is how anomalous data are read in and stored in an instance of miller.array class. In this case I(+) and I(-) will be stored in one miller_array, anomalous_flag will be set to True, and .indices() will contain 'plus' and 'minus' mates as well as singletons. Now, if you want to get separate I(+) and I(-), for an example look in def anomalous_signal(self, use_binning=False): def anomalous_differences(self, enforce_positive_sigmas=False): def hemisphere_acentrics(self, plus_or_minus): def hemispheres_acentrics(self): def convert_to_non_anomalous_if_ratio_pairs_lone_less_than(self, threshold): in cctbx/miller/https://urldefense.proofpoint.com/v2/url?u=http-3A__-5F-5Finit… . Pavel On 6/9/20 07:55, Mooers, Blaine H.M. (HSC) wrote: > Dear CCTBX experts, > > The diffraction data for 3hz7 from RC Researcher's question includes one dataset with column labels of 'I(+)', 'SIGI(+)', 'I(-)', 'SIGI(-)'. > When the diffraction data of 3hz7 data are read from a mtz file into miller arrays, > it would appear that the I(+) and I(-) are stored in a single column of intensities rather than two parallel columns. > > from iotbx.reflection_file_reader import any_reflection_file > > hkl_file = any_reflection_file('3hz7.mtz') > miller_arrays = hkl_file.as_miller_arrays(merge_equivalents=False) > Iobs = miller_arrays[1] > list(Iobs[100:105]) > > [((7, 4, 38), 84.0, 52.20000076293945), > ((-7, -4, -38), 112.80000305175781, 48.20000076293945), > ((8, 4, 38), 119.69999694824219, 57.400001525878906), > ((-8, -4, -38), 152.10000610351562, 65.9000015258789), > ((6, 5, 38), 732.5, 57.5)] > > How would I extract the I(+) and I(-) into lists to plot against each other in a scatter plot in matplotlib? > > > Best regards, > > Blaine > > Blaine Mooers, Ph.D. > Associate Professor > Department of Biochemistry and Molecular Biology > College of Medicine > University of Oklahoma Health Sciences Center > S.L. Young Biomedical Research Center (BRC) Rm. 466 > 975 NE 10th Street, BRC 466 > Oklahoma City, OK 73104-5419 > > _______________________________________________ > cctbxbb mailing list > cctbxbb(a)phenix-online.org > https://urldefense.proofpoint.com/v2/url?u=http-3A__phenix-2Donline.org_mai…

2 1

How to extract I(+) and I(-) from miller array?
by Mooers, Blaine H.M. (HSC) 10 Jun '20

10 Jun '20

Dear CCTBX experts, The diffraction data for 3hz7 from RC Researcher's question includes one dataset with column labels of 'I(+)', 'SIGI(+)', 'I(-)', 'SIGI(-)'. When the diffraction data of 3hz7 data are read from a mtz file into miller arrays, it would appear that the I(+) and I(-) are stored in a single column of intensities rather than two parallel columns. from iotbx.reflection_file_reader import any_reflection_file hkl_file = any_reflection_file('3hz7.mtz') miller_arrays = hkl_file.as_miller_arrays(merge_equivalents=False) Iobs = miller_arrays[1] list(Iobs[100:105]) [((7, 4, 38), 84.0, 52.20000076293945), ((-7, -4, -38), 112.80000305175781, 48.20000076293945), ((8, 4, 38), 119.69999694824219, 57.400001525878906), ((-8, -4, -38), 152.10000610351562, 65.9000015258789), ((6, 5, 38), 732.5, 57.5)] How would I extract the I(+) and I(-) into lists to plot against each other in a scatter plot in matplotlib? Best regards, Blaine Blaine Mooers, Ph.D. Associate Professor Department of Biochemistry and Molecular Biology College of Medicine University of Oklahoma Health Sciences Center S.L. Young Biomedical Research Center (BRC) Rm. 466 975 NE 10th Street, BRC 466 Oklahoma City, OK 73104-5419

2 1