Please cite our work as follows if you have used Strym:
Bhadani, Rahul, Matt Bunting, Matthew Nice, Ngoc Minh Tran, Safwan Elmadani, Dan Work, and Jonathan Sprinkle.
Strym: A python package for real-time can data logging, analysis and visualization to work with usb-can interface."
In 2022 2nd Workshop on Data-Driven and Intelligent Cyber-Physical Systems for Smart Cities Workshop (DI-CPS), pp. 14-23. IEEE, 2022.
@inproceedings{bhadani2022strym,
title={Strym: A python package for real-time can data logging, analysis and visualization to work with usb-can interface},
author={Bhadani, Rahul and Bunting, Matt and Nice, Matthew and Tran, Ngoc Minh and Elmadani, Safwan and Work, Dan and Sprinkle, Jonathan},
booktitle={2022 2nd Workshop on Data-Driven and Intelligent Cyber-Physical Systems for Smart Cities Workshop (DI-CPS)},
pages={14--23},
year={2022},
organization={IEEE}
}
A python package for real-time CAN data logging, analysis and visualization to work with USB-CAN Interface.
Strym is a python package that provides APIs to interface with COMMA.AI panda for logging CAN data, analysis and visualization in real-time from supported modern vehicles such Toyota RAV4 and Honda Pilot. There are two kinds of functionality that Strym provides:
- Real-time visualization of CAN data through comma.ai Panda and Giraffe connector.
- Offline analysis and visualization of CAN Data from a CSV Formatted file.
The recommended way to use strym is with UV package manager and virutal environment.
curl https://sh.rustup.rs -sSf | sh
curl -LsSf https://astral.sh/uv/install.sh | sh
Close the terminal and reopen it.
mkdir -p playground/stream
cd playground/stream
uv python install 3.12
uv init --name stream --no-package
uv venv --python 3.12
# activate virtual environment
source .venv/bin/activate
uv add strym
uv add ipykernel
uv add notebook
The above has to be done one time only.
For the subsequent session, do the following, after opening the new terminal
If you have an existing conda environment, deactivate using conda deactivate.
If you have any other python virtual environment, deactivate that as well.
cd playground/stream
source .venv/bin/activate
jupyter notebook
It will launch the jupyter notebook.
Create a new notebook, and add the following code:
import strym
from strym import strymread
# change the file name as per your convenience
file = "2021-06-04-12-01-39_2T3MWRFVXLW056972_CAN_Messages.csv"
r = strymread(file)
r.speed()
If you see the speed dataframe, it means strym is read to be used by you.
You should also be able to use Visual Studio code in the same manner by following the instruction
cd playground/stream
source .venv/bin/activate
code .
Then, you can create a Python notebook, and select the Python Kernel from .venv/bin/activate.
Strym data is capable of handling timeseries data obtained from Comma.ai Panda and Giraffe Connector.
Most functions and methods in strym expects timeseries data of following format
| Time | Message | |
|---|---|---|
| 1 | 1582056042.5040324 | 2.0 |
| 2 | 1582056043.5040324 | 2.1 |
| 3 | 1582056044.5040324 | 2.12 |
| 4 | 1582056045.5040324 | 1.98 |
| 5 | 1582056046.5040324 | 1.6 |
Here, data should be of type Pandas.DataFrame with two columns: Time and Message.
However, scope of strym is not limited to timeseries data obtained from comma.ai Panda. Any timeseries data of above format is capable of harnessing methods available in strym.
You can use Strym for quick visualization by importing strymread:
import strym
from strym import strymread
from strym import ranalyze
import matplotlib.pyplot as plt
import pandas as pd
from pylab import rcParams
import strym.DBC_Read_Tools as dbc
import numpy as np
plt.rcParams["figure.figsize"] = (16,8)
rcParams.update({'font.size': 40})
dbcfile = '/home/ivory/VersionControl/Jmscslgroup/strym/examples/newToyotacode.dbc'
r =strymread(csvfile="/home/ivory/CyverseData/JmscslgroupData/PandaData/2020_02_18/2020-02-18-13-00-42-209119__CAN_Messages.csv", dbcfile=dbcfile)Checkout documentation at https://jmscslgroup.github.io/strym/getting_started.html for more in-depth tutorials.
- Ubuntu 20.04 or higher
- Python 3.12
- UV package manager
If you are going to install the package on RASPBERRY PI, I highly recommend installing Python 3.7 from the source as there is no Py3.7 release for Raspberry PI. You will also need to install pre-compiled binaries for NumPy otherwise you may encounter huge inconvenience while building NumPy wheels for Raspberry PI.
- comma.ai CAN-USB Panda board.
- comma.ai Giraffee Connector
- A modern vehicle with CAN Bus available such as Toyota RAV4, Toyota CHR, etc.
Plug your Comma AI Panda device using Giraffe Connector to your CAR's OBD port for data logging and streaming. Insert one end of the USB to Panda Device and another end to your laptop.
In python, you will be required to create an object of type Strym:
See strym_impl.py for one such usage example in the example folder, however, I am provided details of an example below:
Create a new file. I will use the gedit to create a new file. You will be required to pass a path of the CAN Database DBC file to strym while instantiating its object. Once you have a strym object, you can call its isoviz() function. isoviz() function takes two arguments: i) the message type that you want to visualize, e.g. SPEED ii) attribute number to plot specific signal of the desired message type. isoviz() function will simultaneously capture CAN message in a CSV file and also plot the desired message's signal. To terminate, press CTRL-C. Upon pressing CTRL-C, a SIGINT signal handler will be called that will terminate the logging of CAN messages and also save a matplotlib figure of the desired message's signal in pdf and pickle format.
gedit viz_example.pyfrom strym import strym
import cantools
import sys, math, time
import signal
db = './newToyotacode.dbc'
Viz = strym(dbcfile = db)
message_type_to_visualize = 'SPEED'
message_attribute_number_to_visualize = 1
visualize = False
options = {"log": "info" }
Viz.isolog(visualize, message_type_to_visualize, message_attribute_number_to_visualize, **options)
signal.signal(signal.SIGINT, Viz.kill)
print('Datafile saved is {}'.format(Viz.logfile))
You will need a DBC file to parse can messages. Download an example DBC file here
To run the above program:
python viz_example.py`If you are done, press CTRL-C.
If you run into any issues, please use the issue feature of GitHub to log your issues. I will try my best to address any issue as soon as possible.
For an issue related to installation/use on windows, please see following filed issues:
If you like to contribute to this project, please fork this repository to your GitHub account, create a new branch for yourself and send a pull request for the merge. After reviewing the changes, we will decide if this is a good place to add your changes.
- Rahul Bhadani ( [email protected])
- Jonathan Sprinkle ([email protected])
- Gustavo Lee ([email protected])
- Matthew Nice ([email protected])
- George Gunter ([email protected])
- Safwan Elmadani ([email protected])
License: MIT License
Copyright 2019-2020 Rahul Bhadani, Jonathan Sprinkle, Arizona Board of Regents
Initial Date: Nov 12, 2019
Permission is hereby granted, free of charge, to any person obtaining
a copy of this software and associated documentation files
(the "Software"), to deal in the Software without restriction, including
without limitation the rights to use, copy, modify, merge, publish,
distribute, sublicense, and/or sell copies of the Software, and to
permit persons to whom the Software is furnished to do so, subject
to the following conditions:
The above copyright notice and this permission notice shall be
included in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF
ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED
TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A
PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT
SHALL THE AUTHORS, COPYRIGHT HOLDERS OR ARIZONA BOARD OF REGENTS
BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN
AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE
OR OTHER DEALINGS IN THE SOFTWARE.