288 views
--- title: Notes of XDAQ Learning tags: daq, gem --- **Notes of XDAQ Learning** --- **Table of Content** [TOC] <!--- pandoc --variable urlcolor=cyan Notes.md -o Notes.pdf --highlight-style=kate --toc --> --- # New possible task 1. https://github.com/cms-gem-daq-project/ctp7_modules/issues/55 2. https://github.com/cms-gem-daq-project/ctp7_modules/issues/62 # To Do - [x] Understand temperature sink - [x] Use it for only those channels that needs it. Else don't use it. - [x] Understand the output of each channel. If they make sense or not? - The output of channels are in decimal. - Voltages are in mili-volts - temperature are in $^0$C. - [x] Close the issue 118 - [x] Close issue 119 - [x] Improve the current function for the nice print output. - [x] Open a new issue having details of bus error - [ ] create few functions that can read all tem sensors, voltage sensors, and all of them at a time - [x] Make elog for issue in [#119](https://github.com/cms-gem-daq-project/ctp7_modules/issues/119), [904 Integration elog](https://cmsonline.cern.ch/webcenter/portal/cmsonline/pages_common/elog?__adfpwp_action_portlet=623564097&__adfpwp_backurl=https%3A%2F%2Fcmsonline.cern.ch%3A443%2Fwebcenter%2Fportal%2Fcmsonline%2Fpages_common%2Felog%3FMedia-Type%3Dscreen%26Media-Feature-Scan%3D0%26Media-Feature-Orientation%3Dlandscape%26Media-Feature-Device-Height%3D1050%26Media-Feature-Height%3D789%26_afrWindowMode%3D0%26Media-Feature-Monochrome%3D0%26Font-Size%3D16%26Media-Feature-Color%3D8%26Media-Featured-Grid%3D0%26_afrLoop%3D12894451140606290%26Media-Feature-Resolution%3D192%26Media-Feature-Width%3D1680%26Media-Feature-Device-Width%3D1680%26Media-Feature-Color-Index%3D0%26Adf-Window-Id%3Dw0%26__adfpwp_mode.623564097%3D1&_piref623564097.strutsAction=%2FviewSubcatMessages.do%3FcatId%3D791%26subId%3D799%26page%3D1). - [x] Remove warnings of unsigned int from code. - [x] comment out channels that are not used. - [x] Implement the Jared comments ## GitHub Issues - [x] https://github.com/cms-gem-daq-project/ctp7_modules/issues/118 - [x] https://github.com/cms-gem-daq-project/ctp7_modules/issues/100 - [x] https://github.com/cms-gem-daq-project/ctp7_modules/issues/119 # Questions # XDAQ General # Login To DAQ machine * To login use: ```bash ssh -XY gem904daq02 ``` * Things to export after login ```bash export PETA_STAGE=/data/bigdisk/sw/peta-stage source /data/bigdisk/sw/Xilinx/SDK/2016.2/settings64.sh ``` * One should work in NAS area, whose path is `/data/bigdisk/users/rasharma` * To setup the CTP7 module area ```bash git clone git@github.com:cms-gem-daq-project/ctp7_modules.git cd ctp7_modules/ git submodule init git submodule update make ``` # Some materials to read 1. CTP7 module github readme: [https://github.com/cms-gem-daq-project/ctp7_modules/blob/develop/README.md](https://github.com/cms-gem-daq-project/ctp7_modules/blob/develop/README.md) 1. GEM electronics user guide: [https://github.com/cms-gem-daq-project/sw_utils/blob/develop/v3ElectronicsUserGuide.md](https://github.com/cms-gem-daq-project/sw_utils/blob/develop/v3ElectronicsUserGuide.md) 2. GBT SCA user manual: [https://espace.cern.ch/GBT-Project/GBT-SCA/Manuals/GBT-SCA-UserManual.pdf](https://espace.cern.ch/GBT-Project/GBT-SCA/Manuals/GBT-SCA-UserManual.pdf) 3. FW docs: 1. CTP7 v3 Address Table : [https://www.dropbox.com/s/r1vic58oh12t9i3/table_ctp7.pdf?dl=0](https://www.dropbox.com/s/r1vic58oh12t9i3/table_ctp7.pdf?dl=0) 2. Optohybrid v3 Address Table : [https://www.dropbox.com/s/qb3i2omxjba0ug3/table_oh.pdf?dl=0](https://www.dropbox.com/s/qb3i2omxjba0ug3/table_oh.pdf?dl=0) # Check the modules on DAQ system 1. Login to machine `ssh -XY gem904daq01`. 1. Power on the power supply: 1. Access the CAEN module 1527 using: `telnet DCS2PS 1527`. For this you need username and password which is `gemuser` and `gemuser` respectively. 1. **SPACE** => Switch on/off power supply 1. **TAB** => Go to main menu 1. Which channel to power on? : 1. Copy the executables of CTP7 module to the location `/mnt/persistent/rpcmodules/` which is on eagle34. 1. Go to your **lib** directory and run: ```bash cd <YourPath>/ctp7_modules/lib scp *.so gemuser@eagle34:/mnt/persistent/rpcmodules/ ``` 1. Set the CTP7 environment ```bash ssh -XY gem904daq01 export LD_LIBRARY_PATH=/opt/xdaq/lib:$LD_LIBRARY_PATH export LD_LIBRARY_PATH=/opt/wiscrpcsvc/lib:$LD_LIBRARY_PATH export LD_LIBRARY_PATH=/opt/rwreg/lib:$LD_LIBRARY_PATH export LD_LIBRARY_PATH=/opt/xhal/lib:$LD_LIBRARY_PATH export PETA_STAGE=/data/bigdisk/sw/peta-stage/ source /data/bigdisk/sw/Xilinx/SDK/2016.2/settings64.sh export PATH=/opt/xhal/bin:$PATH export PATH=/opt/cmsgemos/bin:$PATH source /opt/cmsgemos/etc/profile.d/gemdaqenv.sh # Login to CTP7 gem_reg.py > connect eagle34 ``` If there is any issue with the above command it means we are unable to load the appropriate environment. 1. Login to the **CTP7** to check the log 1. You can login to the **CTP7** from **gem904daq01** machine only. 1. Login using: `ssh gemuser@eagle34`. Password `gemuser`. 1. See if there is rpcsvc running or not: `ps |grep rpcsvc` 2. Start the **rpcsvc**: `rpcsvc` 3. Check the log: `tail -f /var/log/messages` 4. To kill the **rpcsvc**: `killall rpcsvc` 1. To establish the connection with detector: 1. First set the environment: ```bash ssh -XY gemuser@gem904daq01 export LD_LIBRARY_PATH=/opt/xdaq/lib:$LD_LIBRARY_PATH export LD_LIBRARY_PATH=/opt/wiscrpcsvc/lib:$LD_LIBRARY_PATH export LD_LIBRARY_PATH=/opt/rwreg/lib:$LD_LIBRARY_PATH export LD_LIBRARY_PATH=/opt/xhal/lib:$LD_LIBRARY_PATH export PETA_STAGE=/data/bigdisk/sw/peta-stage/ source /data/bigdisk/sw/Xilinx/SDK/2016.2/settings64.sh export PATH=/opt/xhal/bin:$PATH export PATH=/opt/cmsgemos/bin:$PATH source /opt/cmsgemos/etc/profile.d/gemdaqenv.sh ``` 1. Command to run: ```bash testConnectivity.py -o OHMASK --shelf=1 --slot=SLOT --skipDACScan --skipScurve --nPhaseScans=100 2>&1 | tee connectivityLog.log ``` In above command: - **OHMASK** = 0x200. (As our OH is at 9th channel) - **SLOT = 2** ```bash testConnectivity.py -o 0x200 --shelf=1 --slot=2 --skipDACScan --skipScurve --nPhaseScans=100 ``` 1. To save outputs of the above command in a text file use: ```bash testConnectivity.py <usual_options> -d 2>&1 | tee /tmp/connectivity-test-$(date +"%Hh%M-%d%m%y").log ``` 1. nnn ```bash testConnectivity.py 1 2 0x100 --skipDACScan --skipScurve --nPhaseScans=100 -i --gemType ge11 --detType short ``` 1. Run the executable: ```bash #make clean make make test # set the environment export LD_LIBRARY_PATH=/opt/xdaq/lib:$LD_LIBRARY_PATH export LD_LIBRARY_PATH=/opt/wiscrpcsvc/lib:$LD_LIBRARY_PATH export LD_LIBRARY_PATH=/opt/rwreg/lib:$LD_LIBRARY_PATH export LD_LIBRARY_PATH=/opt/xhal/lib:$LD_LIBRARY_PATH export PETA_STAGE=/data/bigdisk/sw/peta-stage/ source /data/bigdisk/sw/Xilinx/SDK/2016.2/settings64.sh export PATH=/opt/xhal/bin:$PATH export PATH=/opt/cmsgemos/bin:$PATH source /opt/cmsgemos/etc/profile.d/gemdaqenv.sh cd bin ./blaster eagle34 1b 0x200 ``` Above `make test` compiles the file in the **test** directory. Then one should get a executalble name **blaster** in **lib** dierectory. Using this run the module that we created. As it takes two argument the first one is the SCA channel and the second one is the **ohMask**. *Then check the output in the terminal where you run the **rpcsvc*** # Email: Checking OH Voltages and Temperatures Reference: - Email from Evaldas Juska forwarded by Brian Dorney - Subject of email: "OH voltage and temperature monitoring" ``` OHs have two separate paths to read various voltages and temperatures: * Xilinx FPGA SysMon can be accessed by JTAG and provides FPGA core temperature, Vccint (core voltage, should be 1V), and Vccaux (I/O voltage, should be 2.5V). These readings can be accessed by sca.py sysmon function. Although generally accessing the JTAG port is not recommended during stable operation since it has been shown to cause strange problems in CSC, besides it's doubtful how much useful info one could get from the sysmon voltage readings since sysmon itself would likely stop functioning if these voltages are out of range (especially the core voltage) * SCA ADC is monitoring several voltages on the OH board, as well as PT100 temperature sensors. This is the recommended method to monitor the OH voltages and temperatures, and the procedure of how to do it is outlined below. CTP7 is instructing the SCA to cycle through ADC channels and readout measurements any time the SCA is idle. This can be disabled in order to not interfere with SCA command heavy operations like accessing the JTAG chain e.g. for programming the OH FPGA, because even though the ADC measurements are done in idle periods, they do take a lot of time to complete and can delay new SCA command requests and even result in a timeout for these new incoming commands. SCA ADC monitoring registers are located under GEM_AMC.SLOW_CONTROL.SCA.ADC_MONITORING. Monitoring can be enabled/disabled by MONITORING_OFF register, which is a bitmask that defines for which OHs this monitoring should be off/paused (monitoring is stopped by sca.py tool for most SCA operations). Once the monitoring is enabled, these readonly registers will be updating every ~200us (one channel at a time): * AVCCN (1.0V MGT power, used in 8b10b links e.g. trigger links) * AVTTN (1.2V MGT power, used in 8b10b links e.g. trigger links) * 1V0_INT (1.0V FPGA core power) * 1V8F (1.8V PROM power) * 1V5 (1.5V power for GBTX and SCA) * 2V5_IO (2.5V FPGA I/O power) * 3V0 (3.3V supply used as input to 1.5V, 2.5V, and 1.8V regulators, also used for CCB interface, and JTAG) * 1V8 (1.8V supply used as input to AVCCN 1.0V, AVTTN 1.2V, and 1.0V FPGA core regulators) * VTRX_RSSI2 (Signal strength of VTRX2, although this is not useful due to a hardware design flaw) * VTRX_RSSI1 (Signal strength of VTRX1, although this is not useful due to a hardware design flaw) * SCA_TEMP (SCA chip temperature) * BOARD_TEMP1 (voltage drop over PT100 temperature sensor in position R720) * BOARD_TEMP2 (voltage drop over PT100 temperature sensor in position R721) * BOARD_TEMP3 (voltage drop over PT100 temperature sensor in position R722) * BOARD_TEMP4 (voltage drop over PT100 temperature sensor in position R723) * BOARD_TEMP5 (voltage drop over PT100 temperature sensor in position R724) * BOARD_TEMP6 (voltage drop over PT100 temperature sensor in position R725) * BOARD_TEMP7 (voltage drop over PT100 temperature sensor in position R726) * BOARD_TEMP8 (voltage drop over PT100 temperature sensor in position R727) * BOARD_TEMP9 (voltage drop over PT100 temperature sensor in position R728) Note that all voltages are divided by 3 on the OH board by a voltage divider (temperature sensor voltage is not divided). All values are in units of ADC counts, and this is a 12bit ADC with a range of 0.0 - 1.0V, so each count is 1V / 4095 = 0.244mV. There's not much information about the SCA chip temperature units, but some information can be found in the SCA manual page 52, which shows linear dependence of temperature from -37.5 deg C to 79 deg C corresponding to 790 counts for -37.5degC and going down to about 570 counts for 79degC. For PT100 measurements, a more complex conversion is necessary to covert the ADC counts to temperature. The way it works is that the ADC supplies 100uA current that goes through the PT100 sensor to ground, and the voltage drop over the sensor then corresponds to the temperature. The exact part number of the PT100 sensor we are using is P0K1.1206.2P.B, which has a resistance of 100 Ohms at 0 deg C, and changes by 0.385% per each degree C cumulatively (more info can be found here: http://www.farnell.com/datasheets/2207165.pdf?_ga=2.247382788.1064362929.1535377707-998824428.1535377707 and here: https://www.intech.co.nz/products/temperature/typert/RTD-Pt100-Conversion.pdf). This means that at 0 deg C the voltage drop over the PT100 will be 100uA * 100 Ohms = 10mV, so the ADC will read 1.0V - 10mV = 0.99V, and if the temperature is 30 degC, the PT100 will have a resistance of 111.67 Ohms, and so the voltage drop will be 100uA * 111.67 Ohms = 11.167mV, so the ADC will read 1.0V - 11.167mV = 0.988833V. ``` # Some issues and their solution ## Error: Bad (OH,VFAT) pairs I am trying to access OH9, selft=1 and slot=2 using command ```bash testConnectivity.py -o 0x200 --shelf=1 --slot=2 --skipDACScan --skipScurve --nPhaseScans=100 ``` Getting below error while establishing communication using script `testConnectivity.py`. ``` GBT Phase Scans Failed to Find Proper Phases List of Bad (OH,VFAT) pairs: [(9, 13), (9, 14), (9, 15), (9, 20), (9, 21), (9, 22), (9, 23)] Try checking: 1. OH is firmly inserted into the Samtec Conncetor (press with fingers along connector vias) 2. VFATs mentioned above are inserted into the 100-pin connector on the GEB 3. VDD on VFATs mentioned above is at least 1.20V Connectivity Testing Failed ``` **Solution:** The above issue arises because the corresponding VFATs are not installed on GE1/1. So, we can skip the VFAT sync error using the option `-i` available in script `testConnectivity.py`. ## Some other commands ```bash ps |grep telnet ps aux |grep telnet kill 19625 killall rpcsvc && rpcsvc ``` ```bash nm lib/amc.so | c++filt nm lib/amc.so | c++filt | fgrep -i sca ``` # Description of commands ## telnet ```bash telnet [options] [host [port]] ``` ## nm ## c++flit