archive/LordTubeMaster
archive/LordTubeMaster
6
0
Fork 0
mirror of https://github.com/eyaler/LordTubeMaster.git synced 2026-08-20 20:35:17 +00:00
Code Issues Projects Releases Packages Wiki Activity
Live YouTube processing in client-side JS using self screen capture https://eyaler.github.io/LordTubeMaster/
84 commits 1 branch 0 tags 2.9 MiB
  • JavaScript 82.8%
  • Jupyter Notebook 12%
  • HTML 3.8%
  • CSS 1.4%
Find a file
Exact
Eyal Gruss 8960774b4e bump lib versions
2024-11-29 11:24:51 +02:00
libs/swissgl folder reorg 2024-09-25 14:23:36 +03:00
media folder reorg 2024-09-25 14:23:36 +03:00
models fix ruttetra mouse+animation interaction; fix splitrgb scale 2024-10-15 14:51:16 +03:00
utils add video reload shortcut 2024-10-14 12:48:55 +03:00
index.html versions bump 2024-10-27 17:45:53 +02:00
LICENSE Initial commit 2024-04-28 15:38:33 +03:00
LordTubeMaster.svg revert from transformers.js 3beta to 2 due to crash; add architecture diagram 2024-09-19 08:16:32 +03:00
README.md versions bump 2024-10-27 17:45:53 +02:00
script.js bump lib versions 2024-11-29 11:24:51 +02:00
style.css add known issues to readme; dont capture on focus, but add capture on event change 2024-09-23 18:41:21 +03:00

README.md

LordTubeMaster

Live YouTube processing in client-side JS using self screen capture

Demo: https://eyaler.github.io/LordTubeMaster/#dQw4w9WgXcQ

Note as of late 2024 this is only supported on Chromium desktop (e.g. Chrome, Edge).

Enable graphics/hardware acceleration browser setting to reduce lag. Particularly for the WebGPU examples - make sure your system graphics settings for the browser uses high performance / discrete GPU.

To allow fullscreen zoom of output (with right-click) enable: chrome://flags/#element-capture (Google Chrome 121+), or chrome://flags/#enable-experimental-web-platform-features (Chromium 121+), and relaunch the browser.

You can browse the effects with Alt+↑ and Alt+↓

The code demos usages with Wasm (MediaPipe), WebGPU (ONNX Runtime Web, TensorFlow.js, Transformers.js), WebGL (Three.js, SwissGL), and VanillaJS.

Known issues:

  1. Resolution of captured media is doubled for smaller frames: https://github.com/screen-share/element-capture/issues/44

Demo video:

(Using RTX 3070 Ti laptop @ 1920x1080)

Demo Video


High-level architecture and implemented modules:

Architecture


Exhibited in /'fu:bar/ glitch art festival exhibition in 2024.