Barcode
Detect & decode the barcode. Orientation is derived from the result — if the barcode reads correctly the bottle is upright; if not, it's flipped.
Project Beacon · capabilities showcase
People movement at scale · 3D scans of real environments · robot, conveyors, sensors on the scan.
The established crowd-simulation tools in this space are mostly offline planning suites — desktop builds, fixed scenarios, batch runs. We took the same problem and built something that runs live, in the browser, on a real 3D scan of the space — interactive while the floor plan is still being argued about.
KAUST digital twin
Agents don't follow waypoints. Each one carries a destination policy — population segments commute to work, students go to class, services attract residents on a daily rhythm.
Buildings emit attraction signals that bias agent decisions in real time, parameterised by time-of-day, capacity, and function.
Policies are reinforcement-learning trained on real KAUST campus movement data.
COP28 · KAUST booth · CitiesOS live demo
Live · People movement
Engine. All 37 run in parallel on the GPU, every frame, for every agent. A physics layer resolves separation and collision alongside. Everything runs in the browser — no install. Scales by swapping the geometry.
Real industrial spaces scanned with a handheld camera or drone, reconstructed into a photorealistic 3D environment, delivered as a browser experience. One pipeline, several fidelities depending on what the use case needs.
A captured ground truth of what is actually built — so a digital model can be compared against, and registered to, the real environment.
Live · 3D scan walk-through
Live · Industrial cell on the scan
The next demo combines the previous two pieces on one screen — a virtual process walkthrough of an installed cell, on the actual scanned environment, before any equipment moves. Directly applicable to Beacon §3.4 — operator training, digital work-instruction validation, and pre-build line review.
Scene authoring
Photogrammetric captures are usually read-only — what you scanned is what you get.
Ours aren't. We can subtract any volume from the captured 3D scene, then insert authored CAD — a robotic arm, a conveyor, a fixture — into the resulting void.
The same browser viewer, on the same real environment, now hosting whatever needs to be prototyped against it before anyone moves a piece of equipment.
BitXaminer — drill-bit inspection deployed at Aramco. Multi-view photogrammetric capture reconstructs each bit at sub-millimetre fidelity — individual cutter elements on a ~10 mm cutter zone, micro-chips, and fracture lines are resolved and graded. Same reconstruction discipline maps directly to Beacon §3.1's 0.10 mm electrical-clip target.
The next phase replaces every manual handoff with a closed-loop facility. A conveyor + overhead gantry walks each drill-bit through loading → cleaning → coloring → scanning → unloading; a robotic arm and adaptive camera rig position the optics for any bit geometry — no human in the dimensional loop.
BitXaminer automated facility · concept renders
Inline inspection deployed with HiRoll Technology. Three detection methods running concurrently on a single NVIDIA Jetson edge unit — plug-and-play on the line, no programming required.
LineEye · datasheet & live inspection app
Detect & decode the barcode. Orientation is derived from the result — if the barcode reads correctly the bottle is upright; if not, it's flipped.
Analyses the bottle's silhouette to determine which side the handle and cap face — at line speed, no fiducials required.
Top-view colour segmentation isolates the bottle body and cap. Robust under variable line lighting.
GenSet Analytics — a camera and Jetson box mounted on the rig deck, watching four diesel generators and reporting each one's load class every five seconds. The same edge-CV discipline AME needs for inline anomaly detection at AMP2.
ADES drilling rig · solar-powered camera trailer · PTZ cam + Jetson Xavier NX
What the camera watches · exhaust lid angle → load class
Same edge-CV camera, different inference: video stabilisation → ROI tracking → signal generation → downhole RPM and vibration estimates. Stick-slip and twist-off events surface on a dashboard without putting any new sensor downhole.
KAUST robotics collaboration with United Robotics Group (Germany) — a unified portfolio spanning autonomous mobile robots, lab-automation manipulators, and a humanoid programme. Direct pathway into Beacon §3.2 (humanoid & advanced robotics).
Sub-millimetre photogrammetric reconstruction (BitXaminer). Edge CV in production with calibration discipline (GenSet, Drillstring). Multi-method on-line inspection (LineEye / HiRoll). Architecture pattern transfers to AMP2's electrical-clip station at the 0.10 mm target.
→ slides 13 · 14 · 15 · 16 · 17
Active partnership with United Robotics Group (DE) — autonomous mobile robots, lab-automation manipulators, humanoid platform. Robotic cells composited directly into captured plant geometry for prototyping prior to physical install.
→ slides 12 · 18
GPU pedestrian / AMR-traffic model with reinforcement-learned destination policies over the KAUST campus twin (CitiesOS). 3D-Gaussian capture of real industrial space, executed at scale on Shaheen III.
→ slides 03 · 04 · 06 · 07 · 08
Browser-renderable 3D-Gaussian scenes used as virtual process walkthroughs — robotic cells, conveyors, sensors composited on the captured environment. Operator training and pre-build line review without bespoke hardware.
→ slides 10 · 11 · 12
Omniverse compatibility. 3D-Gaussian scenes we capture at KAUST are natively importable into NVIDIA Omniverse via the NuRec libraries (3DGS → OpenUSD), so they sit alongside Lucid's existing Omniverse work on the AMP1 Powertrain Pack Line rather than replacing it.
Mohammed-iliès Ayachi · mohammed.ayachi@kaust.edu.sa
Prof. Shehab Ahmed · shehab.ahmed@kaust.edu.sa