02/03/20 [imagej-elphel][lwir] by AndreyFilippov: separate adjustment parameters for GT-base fitting
AndreyFilippov committed changes to the Elphel git project :
separate adjustment parameters for GT-base fitting
separate adjustment parameters for GT-base fitting
02/03/20 [imagej-elphel][lwir] by AndreyFilippov: updating correction
AndreyFilippov committed changes to the Elphel git project :
updating correction
updating correction
02/01/20 [imagej-elphel][lwir] by AndreyFilippov: tested new fiel calibration with ers
AndreyFilippov committed changes to the Elphel git project :
tested new fiel calibration with ers
tested new fiel calibration with ers
01/29/20 [imagej-elphel][lwir] by AndreyFilippov: tested new extrinsic adjustment including ERS rotation
AndreyFilippov committed changes to the Elphel git project :
tested new extrinsic adjustment including ERS rotation
tested new extrinsic adjustment including ERS rotation
01/24/20 [imagej-elphel][lwir] by AndreyFilippov: prepared ers data for fitting
AndreyFilippov committed changes to the Elphel git project :
prepared ers data for fitting
prepared ers data for fitting
01/23/20 [imagej-elphel][lwir] by AndreyFilippov: debugging "lazy eye". Found residual is due to ERS
AndreyFilippov committed changes to the Elphel git project :
debugging "lazy eye". Found residual is due to ERS
debugging "lazy eye". Found residual is due to ERS
01/21/20 [imagej-elphel][lwir] by AndreyFilippov: more debugging LMA lazy eye
AndreyFilippov committed changes to the Elphel git project :
more debugging LMA lazy eye
more debugging LMA lazy eye
01/19/20 [imagej-elphel][lwir] by AndreyFilippov: Debugging polynomial fitting as initial for LMA
AndreyFilippov committed changes to the Elphel git project :
Debugging polynomial fitting as initial for LMA
Debugging polynomial fitting as initial for LMA
Feeding Tensorflow from GPU
← Older revision
Revision as of 17:04, 15 January 2020
(25 intermediate revisions by the same user not shown)Line 1:
Line 1:
==About== ==About==
+Reference guides:
+* [https://viralfsharp.com/2019/03/25/supercharging-object-detection-in-video-from-glacial-to-lightning-speed/ Supercharging Object Detection in Video: from Glacial to Lightning Speed]
+* [https://viralfsharp.com/2019/03/25/supercharging-object-detection-in-videos-setup/ Setup]
+* [https://viralfsharp.com/2019/03/25/supercharging-object-detection-in-video-first-app/ First App]
+* [https://viralfsharp.com/2019/03/25/supercharging-object-detection-in-video-optimizing-decoding-and-graph-feeding/ Optimizing Decoding and Graph Feeding]
+
+Target projects:
+* '''tensorflow-object-detection-cpp''' - contains a sample model, labels and a test video
+* '''fast_od''' - contains feeding Tensorflow from GPU
==Setup== ==Setup==
+Kubuntu 18.04, CUDA 10.0 (10.0 is a requirement for Java version of TF 1.15 in Maven CDN):
+ <font size=2>sudo apt install build-essential
+ sudo apt install git curl
+
+ mkdir -p ~/git/tf_cv_cu
+ cd ~/git/tf_cv_cu
+
+ '''# Download section'''
+ <nowiki>git clone https://github.com/fierval/tensorflow-object-detection-cpp.git
+git clone https://github.com/fierval/fast_od.git
+wget https://github.com/Kitware/CMake/releases/download/v3.16.2/cmake-3.16.2.tar.gz
+wget https://github.com/bazelbuild/bazel/releases/download/0.25.2/bazel_0.25.2-linux-x86_64.deb
+wget https://github.com/tensorflow/tensorflow/archive/v1.15.0.tar.gz -O tensorflow-1.15.0.tar.gz
+wget https://github.com/opencv/opencv/archive/3.4.9.tar.gz -O opencv-3.4.9.tar.gz
+wget https://github.com/opencv/opencv_contrib/archive/3.4.9.tar.gz -O opencv_contrib-3.4.9.tar.gz</nowiki>
+
+ '''# Unpack archives'''
+ tar xzvf cmake-3.16.2.tar.gz
+ tar xzvf tensorflow-1.15.0.tar.gz
+ tar xzvf opencv-3.4.9.tar.gz
+ tar xzvf opencv_contrib-3.4.9.tar.gz
+
+ '''# Build & update cmake'''
+ sudo apt install libssl-dev
+ sudo apt install qt4-default
+ cd cmake-3.16.2
+ ./bootstrap -qt-gui
+ make -j8
+ sudo make install
+
+ cmake -version
+ cmake-gui -version
+
+ '''# Install bazel'''
+ sudo dpkg -i bazel_0.25.2-linux-x86_64.deb
+ bazel version
+
+ '''# Build TF'''
+ cd ~/git/tf_cv_cu/tensorflow-1.15.0/
+ tensorflow/contrib/makefile/download_dependencies.sh
+ ./configure
+ '''# pick all defaults except select '''yes''' for CUDA support'''
+ bazel build //tensorflow:libtensorflow_cc.so
+
+ '''# Install TF with headers'''
+ sudo mkdir /usr/local/tensorflow
+ sudo mkdir /usr/local/tensorflow/include
+ sudo cp -r tensorflow/contrib/makefile/downloads/eigen/Eigen /usr/local/tensorflow/include/
+ sudo cp -r tensorflow/contrib/makefile/downloads/eigen/unsupported /usr/local/tensorflow/include/
+ sudo cp tensorflow/contrib/makefile/downloads/nsync/public/* /usr/local/tensorflow/include/
+ sudo cp -r bazel-genfiles/tensorflow /usr/local/tensorflow/include/
+ sudo cp -r tensorflow/cc /usr/local/tensorflow/include/tensorflow
+ sudo cp -r tensorflow/core /usr/local/tensorflow/include/tensorflow
+ sudo mkdir /usr/local/tensorflow/include/third_party
+ sudo cp -r third_party/eigen3 /usr/local/tensorflow/include/third_party/
+ sudo mkdir /usr/local/tensorflow/lib
+ sudo cp bazel-bin/tensorflow/libtensorflow_*.so /usr/local/tensorflow/lib
+ '''# extras, not mentioned in the reference guide'''
+ sudo cp -r tensorflow/contrib/makefile/downloads/absl/absl /usr/local/tensorflow/include/
+ sudo cp -r tensorflow/contrib/makefile/downloads/protobuf/src/google /usr/local/tensorflow/include/
+ sudo cp -r tensorflow/stream_executor /usr/local/tensorflow/include/tensorflow/
+ sudo cp bazel-bin/tensorflow/* /usr/local/tensorflow/lib
+ sudo ln -sf /usr/local/tensorflow/lib/libtensorflow_framework.so.1.15.0 /usr/local/tensorflow/lib/libtensorflow_framework.so
+
+ '''# Build & install OpenCV'''
+ sudo apt install libgtkglext1 libgtkglext1-dev
+ sudo apt install libgtk2.0-dev pkg-config libavcodec-dev libavformat-dev libswscale-dev
+ sudo apt install python-dev python-numpy libtbb2 libtbb-dev libjpeg-dev libpng-dev libtiff-dev libdc1394-22-dev
+ # sudo apt install libjasper-dev '''# no such package in 18.04'''
+
+ sudo cp ~/git/tf_cv_cu/fast_od/docker/nvcuvid/dynlink_* /usr/local/cuda/include
+
+ cd ~/git/tf_cv_cu/opencv-3.4.9
+ mkdir build; cd build
+ '''# haven't tested this line yet. Did from cmake-gui'''
+ cmake -D WITH_CUDA=ON \
+ -D OPENCV_EXTRA_MODULES_PATH=~/git/tf_cv_cu/opencv_contrib-3.4.9/modules \
+ -D BUILD_PERF_TESTS=OFF \
+ -D BUILD_TESTS=OFF \
+ -D BUILD_opencv_cudacodec=ON \
+ -D WITH_NVCUVID=ON \
+ -D WITH_GTK_2_X=ON \
+ ..
+ make -j8
+ sudo make install
+ sudo ldconfig
+
+ '''# tensorflow-object-detection-cpp'''
+ cd ~/git/tf_cv_cu/tensorflow-object-detection-cpp
+ mkdir build; cd build
+ cmake ..
+ make
+ ./tf_detector_example
+
+ '''# fast_od'''
+ cd ~/git/tf_cv_cu/fast_od
+ mkdir build; cd build
+ cmake ..
+ make
+ '''# update paths paths to the model, labels and the video from tensorflow-object-detection-cpp in fast_od/run_tf.sh'''
+ cd ..
+ ./run_tf_elphel.sh 1</font>
Oleg
Feeding Tensorflow from GPU
Setup
← Older revision Revision as of 01:56, 15 January 2020 (23 intermediate revisions by the same user not shown)Line 1: Line 1: ==About== ==About== +Reference guides: +* [https://viralfsharp.com/2019/03/25/supercharging-object-detection-in-video-from-glacial-to-lightning-speed/ Supercharging Object Detection in Video: from Glacial to Lightning Speed] +* [https://viralfsharp.com/2019/03/25/supercharging-object-detection-in-videos-setup/ Setup] +* [https://viralfsharp.com/2019/03/25/supercharging-object-detection-in-video-first-app/ First App] +* [https://viralfsharp.com/2019/03/25/supercharging-object-detection-in-video-optimizing-decoding-and-graph-feeding/ Optimizing Decoding and Graph Feeding] + +Target projects: +* '''tensorflow-object-detection-cpp''' - contains a sample model, labels and a test video +* '''fast_od''' - contains feeding Tensorflow from GPU ==Setup== ==Setup== +Kubuntu 18.04, CUDA 10.0 (10.0 is a requirement for Java version of TF 1.15 in Maven CDN): + <font size=2>sudo apt install build-essential + sudo apt install git curl + + mkdir -p ~/git/tf_cv_cu + cd ~/git/tf_cv_cu + + '''# Download section''' + <nowiki>git clone https://github.com/fierval/tensorflow-object-detection-cpp.git +git clone https://github.com/fierval/fast_od.git +wget https://github.com/Kitware/CMake/releases/download/v3.16.2/cmake-3.16.2.tar.gz +wget https://github.com/bazelbuild/bazel/releases/download/0.25.2/bazel_0.25.2-linux-x86_64.deb +wget https://github.com/tensorflow/tensorflow/archive/v1.15.0.tar.gz -O tensorflow-1.15.0.tar.gz +wget https://github.com/opencv/opencv/archive/3.4.9.tar.gz -O opencv-3.4.9.tar.gz +wget https://github.com/opencv/opencv_contrib/archive/3.4.9.tar.gz -O opencv_contrib-3.4.9.tar.gz</nowiki> + + '''# Unpack archives''' + tar xzvf cmake-3.16.2.tar.gz + tar xzvf tensorflow-1.15.0.tar.gz + tar xzvf opencv-3.4.9.tar.gz + tar xzvf opencv_contrib-3.4.9.tar.gz + + '''# Build & update cmake''' + sudo apt install libssl-dev + sudo apt install qt4-default + cd cmake-3.16.2 + ./bootstrap -qt-gui + make -j8 + sudo make install + + cmake -version + cmake-gui -version + + '''# Install bazel''' + sudo dpkg -i bazel_0.25.2-linux-x86_64.deb + bazel version + + '''# Build TF''' + cd ~/git/tf_cv_cu/tensorflow-1.15.0/ + tensorflow/contrib/makefile/download_dependencies.sh + ./configure + '''# pick all defaults except select '''yes''' for CUDA support''' + bazel build //tensorflow:libtensorflow_cc.so + + '''# Install TF with headers''' + sudo mkdir /usr/local/tensorflow + sudo mkdir /usr/local/tensorflow/include + sudo cp -r tensorflow/contrib/makefile/downloads/eigen/Eigen /usr/local/tensorflow/include/ + sudo cp -r tensorflow/contrib/makefile/downloads/eigen/unsupported /usr/local/tensorflow/include/ + sudo cp tensorflow/contrib/makefile/downloads/nsync/public/* /usr/local/tensorflow/include/ + sudo cp -r bazel-genfiles/tensorflow /usr/local/tensorflow/include/ + sudo cp -r tensorflow/cc /usr/local/tensorflow/include/tensorflow + sudo cp -r tensorflow/core /usr/local/tensorflow/include/tensorflow + sudo mkdir /usr/local/tensorflow/include/third_party + sudo cp -r third_party/eigen3 /usr/local/tensorflow/include/third_party/ + sudo mkdir /usr/local/tensorflow/lib + sudo cp bazel-bin/tensorflow/libtensorflow_*.so /usr/local/tensorflow/lib + '''# extras, not mentioned in the reference guide''' + sudo cp -r tensorflow/contrib/makefile/downloads/absl/absl /usr/local/tensorflow/include/ + sudo cp -r tensorflow/contrib/makefile/downloads/protobuf/src/google /usr/local/tensorflow/include/ + sudo cp -r tensorflow/stream_executor /usr/local/tensorflow/include/tensorflow/ + sudo cp bazel-bin/tensorflow/* /usr/local/tensorflow/lib + sudo ln -sf /usr/local/tensorflow/lib/libtensorflow_framework.so.1.15.0 /usr/local/tensorflow/lib/libtensorflow_framework.so + + '''# Build & install OpenCV''' + sudo apt install libgtkglext1 libgtkglext1-dev + sudo apt install libgtk2.0-dev pkg-config libavcodec-dev libavformat-dev libswscale-dev + sudo apt install python-dev python-numpy libtbb2 libtbb-dev libjpeg-dev libpng-dev libtiff-dev libdc1394-22-dev + # sudo apt install libjasper-dev '''# no such package in 18.04''' + + sudo cp ~/git/tf_cv_cu/fast_od/docker/nvcuvid/dynlink_* /usr/local/cuda/include + + cd ~/git/tf_cv_cu/opencv-3.4.9 + mkdir build; cd build + '''# haven't tested this line yet. Did from cmake-gui''' + cmake -D WITH_CUDA=ON \ + -D OPENCV_EXTRA_MODULES_PATH=~/git/tf_cv_cu/opencv_contrib-3.4.9/modules \ + -D BUILD_PERF_TESTS=OFF \ + -D BUILD_TESTS=OFF \ + -D BUILD_opencv_cudacodec=ON \ + -D WITH_NVCUVID=ON \ + -D WITH_GTK_2_X=ON \ + .. + make -j8 + sudo make install + sudo ldconfig + </font> Oleg01/14/20 [imagej-elphel][lwir] by AndreyFilippov: fixed LMA for offsets of the multi-tile clusters
AndreyFilippov committed changes to the Elphel git project :
fixed LMA for offsets of the multi-tile clusters
fixed LMA for offsets of the multi-tile clusters
Feeding Tensorflow from GPU
Setup
← Older revision Revision as of 01:42, 15 January 2020 (16 intermediate revisions by the same user not shown)Line 1: Line 1: ==About== ==About== +Reference guides: +* [https://viralfsharp.com/2019/03/25/supercharging-object-detection-in-video-from-glacial-to-lightning-speed/ Supercharging Object Detection in Video: from Glacial to Lightning Speed] +* [https://viralfsharp.com/2019/03/25/supercharging-object-detection-in-videos-setup/ Setup] +* [https://viralfsharp.com/2019/03/25/supercharging-object-detection-in-video-first-app/ First App] +* [https://viralfsharp.com/2019/03/25/supercharging-object-detection-in-video-optimizing-decoding-and-graph-feeding/ Optimizing Decoding and Graph Feeding] + +Target projects: +* '''tensorflow-object-detection-cpp''' - contains a sample model, labels and a test video +* '''fast_od''' - contains feeding Tensorflow from GPU ==Setup== ==Setup== +Kubuntu 18.04, CUDA 10.0 (10.0 is a requirement for Java version of TF 1.15 in Maven CDN): + <font size=2>mkdir -p ~/git/tf_cv_cu + cd ~/git/tf_cv_cu + + '''# Download section''' + <nowiki>git clone https://github.com/fierval/tensorflow-object-detection-cpp.git +git clone https://github.com/fierval/fast_od.git +wget https://github.com/Kitware/CMake/releases/download/v3.16.2/cmake-3.16.2.tar.gz +wget https://github.com/bazelbuild/bazel/releases/download/0.25.2/bazel_0.25.2-linux-x86_64.deb +wget https://github.com/tensorflow/tensorflow/archive/v1.15.0.tar.gz -O tensorflow-1.15.0.tar.gz +wget https://github.com/opencv/opencv/archive/3.4.9.tar.gz -O opencv-3.4.9.tar.gz +wget https://github.com/opencv/opencv_contrib/archive/3.4.9.tar.gz -O opencv_contrib-3.4.9.tar.gz</nowiki> + + '''# Unpack archives''' + tar xzvf cmake-3.16.2.tar.gz + tar xzvf tensorflow-1.15.0.tar.gz + tar xzvf opencv-3.4.9.tar.gz + tar xzvf opencv_contrib-3.4.9.tar.gz + + '''# Build & update cmake''' + sudo apt install libssl-dev + sudo apt install qt4-default + cd cmake-3.16.2 + ./bootstrap -qt-gui + make -j8 + sudo make install + + cmake -version + cmake-gui -version + + '''# Install bazel''' + sudo dpkg -i bazel_0.25.2-linux-x86_64.deb + bazel version + + '''# Build TF''' + cd ~/git/tf_cv_cu/tensorflow-1.15.0/ + tensorflow/contrib/makefile/download_dependencies.sh + ./configure + # pick all defaults except select '''yes''' for CUDA support + bazel build //tensorflow:libtensorflow_cc.so + + '''# Build OpenCV''' + sudo apt install libgtkglext1 libgtkglext1-dev + sudo apt install build-essential + sudo apt install cmake git libgtk2.0-dev pkg-config libavcodec-dev libavformat-dev libswscale-dev + sudo apt install python-dev python-numpy libtbb2 libtbb-dev libjpeg-dev libpng-dev libtiff-dev libdc1394-22-dev + # sudo apt install libjasper-dev # missing in Kubuntu 18.04 + + sudo cp ~/git/tf_cv_cu/fast_od/docker/nvcuvid/dynlink_* /usr/local/cuda/include + + cd ~/git/tf_cv_cu/opencv-3.4.9 + mkdir build; cd build + cmake -D WITH_CUDA=ON \ + -D OPENCV_EXTRA_MODULES_PATH=~/git/tf_cv_cu/opencv_contrib-3.4.9/modules \ + -D BUILD_PERF_TESTS=OFF \ + -D BUILD_TESTS=OFF \ + -D BUILD_opencv_cudacodec=ON \ + -D WITH_NVCUVID=ON \ + -D WITH_GTK_2_X=ON \ + .. + make -j8 + sudo make install + sudo ldconfig + </font> OlegFeeding Tensorflow from GPU
← Older revision
Revision as of 00:30, 15 January 2020
Line 1:
Line 1:
==About== ==About==
+Reference guides:
+* [https://viralfsharp.com/2019/03/25/supercharging-object-detection-in-video-from-glacial-to-lightning-speed/ Supercharging Object Detection in Video: from Glacial to Lightning Speed]
+* [https://viralfsharp.com/2019/03/25/supercharging-object-detection-in-videos-setup/ Setup]
+* [https://viralfsharp.com/2019/03/25/supercharging-object-detection-in-video-first-app/ First App]
+* [https://viralfsharp.com/2019/03/25/supercharging-object-detection-in-video-optimizing-decoding-and-graph-feeding/ Optimizing Decoding and Graph Feeding]
+
==Setup== ==Setup==
Oleg
Feeding Tensorflow from GPU
Created page with "==About== ==Setup=="
New page
==About====Setup== Oleg
01/10/20 [imagej-elphel][lwir] by AndreyFilippov: Implemented 2d maximum modelled as Gaussian in addition to parabola
AndreyFilippov committed changes to the Elphel git project :
Implemented 2d maximum modelled as Gaussian in addition to parabola
Implemented 2d maximum modelled as Gaussian in addition to parabola
01/09/20 [imagej-elphel][lwir] by AndreyFilippov: implemented common offsets for the tile cluster s
AndreyFilippov committed changes to the Elphel git project :
implemented common offsets for the tile cluster s
implemented common offsets for the tile cluster s
Tensorflow with gpu
Tensorflow and OpenCV building notes
← Older revision Revision as of 00:49, 8 January 2020 Line 249: Line 249: ==Tensorflow and OpenCV building notes== ==Tensorflow and OpenCV building notes== −===Targets 1===+===Build 1=== # TF 1.15.0 # TF 1.15.0 # CUDA 10.0 and Toolkit and stuff # CUDA 10.0 and Toolkit and stuff Line 261: Line 261: 3. ./configure 3. ./configure 4. 4. + +===Build 2=== +# TF 1.13.1 +# CUDA 10.0 and Toolkit and stuff +# OpenCV 3.4.9 + +====TF 1.13.1==== +* Will build with Bazel 0.21.0 (installed from [https://github.com/bazelbuild/bazel/releases/tag/0.21.0 deb archive]) OlegFile:333 hd setup.jpg
Andrey.filippov changed visibility of 6 revisions on page File:333 hd setup.jpg: content hidden, edit summary hidden and username hidden vandalism
Andrey.filippovTensorflow with gpu
Notes
← Older revision Revision as of 23:12, 7 January 2020 (One intermediate revision by the same user not shown)Line 1: Line 1: −==Requirements==+==OS== * Kubuntu 16.04 LTS * Kubuntu 16.04 LTS + ==Setup (guide)== ==Setup (guide)== Just follow: Just follow: Line 246: Line 247: # Then open a browser: # Then open a browser: '''http://localhost:6006'''</font> '''http://localhost:6006'''</font> + +==Tensorflow and OpenCV building notes== +===Targets 1=== +# TF 1.15.0 +# CUDA 10.0 and Toolkit and stuff +# OpenCV 3.4.9 + +====TF 1.15.0==== +* Will build with Bazel 0.25.2 (installed from [https://github.com/bazelbuild/bazel/releases/tag/0.25.2 deb archive]) +* TF - downloaded as [https://github.com/tensorflow/tensorflow/releases/tag/v1.15.0 tensorflow-1.15.0.tar.gz] + 1. Unpack + 2. cd tensorflow-1.15.0 + 3. ./configure + 4. OlegTensorflow with gpu
Requirements
← Older revision Revision as of 20:16, 7 January 2020 Line 1: Line 1: −==Requirements==+==OS== * Kubuntu 16.04 LTS * Kubuntu 16.04 LTS + ==Setup (guide)== ==Setup (guide)== Just follow: Just follow: OlegPages
