Smart Data Transaction for CPS: Weekly Meeting Notes
Note:
The Smart Data Transaction blueprint is currently on hiatus and weekly meetings are not being held. You can still contact us through the mailing list: sdt-blueprint@lists.akraino.org
Weekly Meeting Apr 11, 2023
Considering release 8 collaboration with CPS Robot Blueprint family but still need to get our acts together.
Upcoming meetings:
Apr 25, 2023 will be canceled due to overlap with IOWN Global Forum 3rd Annual Members' Meeting
May 2, 2023 will be canceled due to holiday in Japan
May 9, 2023 will be canceled due to travelling to Open Source Summit North America on that day
So next week will be the last regular meeting we can have for a month...
Weekly Meeting Apr 4, 2023
Planning a light-weight release 8. See the presentation from last week's Spring Summit for some ideas.
Resourcing from Fujitsu will be tight this quarter.
Weekly Meeting Mar 28, 2023
Presenting intro to SDT and release 7 at the Spring Summit, day 1. Check the schedule
Weekly Meeting Mar 21, 2023
Canceled due to holiday
Weekly Meeting Mar 14, 2023
Will give a talk on SDT and Akraino Release 7 content at the spring summit.
Next week's meeting canceled due to a holiday in Japan.
Weekly Meeting Mar 7, 2023
Submit proposal to Akraino Spring Summit?
Main Fujitsu resources are in Edge Service Enabling Platform in the coming year, but still looking for some small-scale updates that can be made.
Weekly Meeting Feb 28, 2023
No topics. Fujitsu still in planning phase.
Weekly Meeting Feb 21, 2023
No topics on the agenda today. Fujitsu will be setting resource allocations and plans in the beginning of March, which will allow the project to firm up plans for R8.
Weekly Meeting Feb 14, 2023
Release 8 planning (Upgrade EdgeX? Data lake functionality? Video?)
Weekly Meeting Feb 7, 2023
Smart Data Transaction was marked TSC approved on the Release 7 Planning page Feb 2, 2023
No plans for release 8... yet.
Weekly Meeting Jan 31, 2023
Waiting for results of TSC vote and release 7. Will be brainstorming for release 8 in upcoming weeks.
Weekly Meeting Jan 24, 2023
Upstream subcommittee approved Jan 19, 2023
Presented at TSC but there were not enough TSC members available for a vote, so an email vote will be held
Weekly Meeting Jan 17, 2023
Sent reminder to upstream subcommittee
Will ask for approval at this week's TSC meeting
Weekly Meeting Jan 10, 2023
Security subcommittee has approved for R7.
However, there was some discussion on the mailing list about handling of CVEs which have not been patched by the distro (Ubuntu). It appears these can receive exceptions, but confirm with Daniil & Wenhui.
Upstream subcommittee has not responded yet.
Confirm with Jim.
Weekly Meeting Jan 3, 2023
Canceled: New Year's holiday in Japan
Weekly Meeting Dec 27, 2022
Canceled: Waiting for subcommittee review results.
Next week's meeting will be canceled due to the New Year's holiday in Japan.
Weekly Meeting Dec 20, 2022
Canceled: No issues to address.
R7 planning page updated and subcommittee review requests sent on Dec 19, 2022
Weekly Meeting Dec 13, 2022
Canceled: Colin attending Okinawa Open Days
Weekly Meeting Dec 6, 2022
Meeting canceled: Colin is attending OSS-Japan conference
Note: Next week Colin will be at Okinawa Open Days (13th to 15th), so the meeting will be canceled again. Sorry.
Dec 20, 2022 hopefully will be post R7 approval. We may have a meeting to address release-related issues if necessary.
Weekly Meeting Nov 29, 2022
Canceled (document preparation in progress)
Weekly Meeting Nov 22, 2022
Progress report
Fujitsu/Colin will move the remaining document edits forward and submit to subcommittees for R7.
Expect to skip next week's meeting as only above prep remains.
Weekly Meeting Nov 15, 2022
Progress report
Document updates complete. Colin will confirm drafts.
JFTT to look at possible targets/improvements for R8, and revisit issues that were marked low priority for this release.
Weekly Meeting Nov 8, 2022
Progress report
Install document last few sections updating
Once everything is lined up, we will submit for subcommittee review
Weekly Meeting Nov 1, 2022
Progress report
Install document editing continuing
Updated install scripts ready to commit, Colin to code review
Holiday in Japan this Thursday Nov 3, 2022 and Colin also taking Nov 4, 2022 off
Weekly Meeting Oct 25, 2022
Progress report
Currently confirming updated install scripts
The rest of the document update has been on hold while the scripts were updated
Started updating architecture document and block diagrams
Block diagram and wording updates are complete, for details check the page history
Weekly Meeting Oct 18, 2022
Progress report
BluVal completed
Lynis can't check for update. Possible proxy issue? Include workaround in tests doc.
Install document update in progress
Architecture document still needs confirmation
Action items
Follow up on install scripts (do they need updating or workarounds?)
Weekly Meeting Oct 11, 2022
Progress report
BluVal results being updated. Lynis has some todo items remaining.
CI/regression tests are updated and Colin is checking.
Action items
Data sheet will be updated by Colin.
Move on to release notes and install document. Copy over from release 6 and check what needs updating.
Check if architecture document needs updating.
Weekly Meeting Oct 4, 2022
Meeting canceled
Weekly Meeting Sep 27, 2022
Progress report
Updating test document. Regression test info has been updated except for notes and Nexus links. BluVal info has not been updated (currently a copy of R6).
Colin will check BluVal results as soon as possible and update JFTT on any additional work needed.
If the test document updates are blocked on Colin, JFTT will review release notes and install documents from R6 to determine what needs updating there.
Comment from Tina: Check out the LF Edge Catalog for improving ease of deployment. Consider joining.
Next meeting Oct 4, 2022 will be canceled due to a holiday in China
Weekly Meeting Sep 20, 2022
Progress report
IT and BluVal complete, compiling results
Next will be updating documents for R7, starting with the test documents.
Three day Akraino event starting tomorrow (unfortunately no SDT talk, but Fukano-san will have a talk about the CPS Robot Blueprint family)
Weekly Meeting Sep 13, 2022
Progress report
BluVal
vulstest done, continuing with other BluVal itemsCompiling a list of other integration test items to run
Weekly Meeting Sep 6, 2022
Progress report
Coding and unit tests complete, some design documentation remaining.
Next sprint start integration tests and BluVal. Consult the R6 documents for information on the type of tests required and BluVal procedure.
Test planning and Q&A concerning tests expected to continue this week.
Weekly Meeting Aug 30, 2022
Progress report
Colin is still confirming test results from image analysis but don't foresee any problems
Problem getting eKuiper to send notifications, still investigating
Calling notification API from source is working, so in worst case we can use that directly
Weekly Meeting Aug 23, 2022
Progress report
Image analysis function is implemented, now testing
Can probably move on to automatic actions based on image analysis in next sprint
Colin will communicate basic spec for automatic actions function to the team later today
Weekly Meeting Aug 16, 2022
Meeting canceled
Weekly Meeting Aug 9, 2022
Progress report
Compile of images based on r32.6.1 is working
There is an intermittent issue where CUDA APIs stop responding after 1.5 or so hours of use
The problem above will be investigated in the background while we continue with the coding and tests
If coding completes next week, move on to integration testing of the completed modules (rule-based actuation can wait)
Colin is on vacation next week so the weekly meeting will be canceled
Weekly Meeting Aug 2, 2022
Progress report
Have had success building containers on l4t-base:r32.4.3
Want to upgrade to r32.6.1 to match the version on the Jetson devices
Once that is done, move on to quickly try out the OpenCV and/or CUDA interfaces we're going to use
Check status next week and decide how to progress, especially while Colin is on vacation
Weekly Meeting Jul 26, 2022
Progress report
CUDA-enabled programs work when directly compiled on Jetson, but not in containers.
Seems to be a version mismatch problem. The CUDA version in the containers we are using is 11.7, and the Jetson version is 10.2.
Unfortunately, there doesn't seem to be ARM support for CUDA base containers from NVidia at version 10.2 of CUDA.
Looking for alternatives. Worst case, we may need to build a CPU-only OpenCV container and leave GPU support for later.
Keep trying to get the GPU version working until sprint end Aug 2, 2022, and if we can't get it going, switch to CPU-only for next sprint.
Weekly Meeting Jul 19, 2022
Progress report
Coding and unit test of data sharing complete
Currently examining
How to build containers that contain the CUDA and OpenCV libraries plus drivers for GPU access
How to enable GPU access for containers on the NVidia Jetson
Design of a simple shape-counting app using Go-CV in progress
We are having trouble calling CUDA-enabled Go-CV in the container, with what looks like a driver and library version mismatch. Investigation is ongoing.
Investigation and design of the app scheduled to take the next sprint, until Aug 2, 2022
Weekly Meeting Jul 12, 2022
Progress report
Design of data sharing pretty much complete, maybe a few changes from review comments.
Coding and testing should be complete today, depending on effect of design review comments.
About 1wk ahead of schedule, we should be able to look into image analysis. Issues include:
What, exactly, are we going to do for analysis?
How to use the GPU in the system (can it be done from a container on K8s?)
Will need to sync up on those issues and any others that come up.
Note: Release 7 planning page is up.
Weekly Meeting Jul 5, 2022
Progress report
Implementation of modified device-camera-go for SDT is done (will review)
Test case for snapshot reading from camera devices is done (will review)
Next sprint (ends Jul 19, 2022) combines design and implementation/test for sharing snapshot data between nodes using the sync-app
Colin will be on summer vacation from Aug 11, 2022 to Aug 21, 2022. We'll work on a plan for work done in that period.
Weekly Meeting Jun 28, 2022
Progress report
Investigations of device-camera-go and device-onvif-go are done. We have confirmed we can get snapshots from our camera devices with either device service.
device-onvif-go has a problem with AuthMethod "digest"
Will open a separate issue and put that aside for the moment
Since we have slightly more confidence with device-camera-go, we will continue with that service for now
Hoping to finish the service integration and CT steps by the end of this sprint (Jul 5, 2022)
Weekly Meeting Jun 21, 2022
Progress report
Retrying image pulls worked well enough to build local device-camera-go
Not clear if there is any good solution for overriding the camera IP at run time
Had trouble getting device-camera-go to retrieve images
DeviceResources does not appear to be populated?
Having trouble debugging (e.g. because of image rebuild problems)
Colin will look into the problem as well to see if he can offer support
Release 6 PR is on the marketing page (Smart Data Transactions for CPS section)
Weekly Meeting Jun 14, 2022
Progress report
Mid-sprint 2, focus on design of image acquisition
Some trouble with Docker rate-limiting of anonymous image pulls
Will investigate possible solutions offline
It should be possible to override the camera IP address with an environment variable setting, possibly, which would eliminate the need to rebuild the image
The Python algorithms for using OpenCV don't seem to translate well to Go, producing less acceptable results
Share updates in the ticket with details
IP cameras installed in test environment
Will be moving files in the shared directories between 11:45 and 13:15 JST today
Tina requests if we can add something for SDT to the Release 6 Marketing, hopefully before the NAOSS (6/20)
Weekly Meeting Jun 7, 2022
Progress report
Reviewed function block definitions. Looks ok.
Next sprint (until 6/21) focuses on design of camera device and image reading, sprint after that (until 7/5) will be coding/CT for same.
Install IP cameras on Thursday Jun 9, 2022
Weekly Meeting May 31, 2022
Meeting was held via Fujitsu's Teams account due to problems with Zoom
Progress report
Architecture diagram and document updated on Wiki
Working on functional block list
Check the image analysis example in issue #63 on the local GitLab
Weekly Meeting May 24, 2022
Progress report
Initial sprint plan and backlog complete.
Architecture diagram and function block diagram updates basically complete. Review today.
Running ahead of schedule. Pick up new tasks from the backlog for next sprint as we go.
Cameras will be added to the lab setup as soon as we get the AC adaptors for the cameras.
Meeting with Tina tomorrow at 9AM JST to discuss new blueprint proposal.
From Tina: Reminder to update the R6 marketing case studies.
From Fukano-san: Have updated the LF Edge Commercial Ecosystem presentation.
Weekly Meeting May 17, 2022
R7 Backlog list format ready. Will hold another meeting this week to discuss with JFTT and fill it in.
Sprint planning should be complete for next week's meeting.
We will be using the weekly meeting for progress reports from JFTT, and every two weeks a sprint review.
We will be adding camera devices in the lab setup soon. Will let the team know when they are ready.
Weekly Meeting May 10, 2022
Zoom login problems; meeting held via Teams
Release 6 is apparently delayed as other blueprint teams are still updating their release requirements
SDT work for release 7 will kick off tomorrow. Shared access details for the Fujitsu internal lab environment.
Weekly Meeting May 3, 2022
Cancelled due to holiday in Japan
Weekly Meeting Apr 26, 2022
Progress report:
Release 6 planning table is all green for SDT
New lab setup:
2 Jetsons now available
Gitlab, Jenkins, master and deploy VMs up
Need to configure external access (port forwarding) for Jenkins and deploy VM
Blueprint not installed yet
Weekly Meeting Apr 19, 2022
Progress report:
Conditional approval granted at TSC meeting last Thursday
Fixed security issues and have been approved
Work on release 7 will officially start May 11, 2022
Gitlab server up and running in new lab
Remaining Jetson and VMs will be configured in the next week or two
Weekly Meeting Apr 12, 2022
Progress report:
TSC meeting this week to get approval for release 6
Confirming security and upstream subcommittee approvals
New lab setup: 1 Jetson configured, gitlab being set up now
Weekly Meeting Apr 5, 2022
Anylog demo
Looks interesting for a replacement (possibly optional?) for the data sync component
Colin will send Moshe mail on more areas to discuss
Progress report: