Splashery

Playground
3D World, a still.

Studio · Built from a recipe

3D World

A3 on the major comb. Its drum rings at 229.6 Hz.

Turn it in the PlaygroundTap the picture to strike it.

A video is a string of photos from a moving camera.

Shelf
Studio
Kind
Built from a recipe
Your own
Your own video
Sound
Yes
Licenses
CC BY 3.0, CC BY 4.0, CC0, CC BY-SA 4.0, MIT

Its note

Splashery stretches a drumhead over this Splash's outline, twelve inches across, and finds the ways it can ring. Its lowest is 229.6 Hz, 74 cents sharp of A3, the nearest tine on the comb. The next fifteen are its overtones, and each one draws its own figure: sand gathers on the lines that stay still.

The sixteen ways 3D World's drum can ring, lowest first.
  1. 1230 Hz
  2. 2363 Hz
  3. 3363 Hz
  4. 4459 Hz
  5. 5513 Hz
  6. 6513 Hz
  7. 7585 Hz
  8. 8586 Hz
  9. 9669 Hz
  10. 10669 Hz
  11. 11689 Hz
  12. 12726 Hz
  13. 13726 Hz
  14. 14811 Hz
  15. 15812 Hz
  16. 16827 Hz

How to play

Tap to fly the video's path; drag to look around. Show the original plays the flat video beside it.

Its controls

ControlKindRangeStart
Replay flightTap
Replay flightSwitchOff
Move aroundList2 choicesTurn and zoom
SceneList7 choicesStatue, flown around
Start (s)Setting
LengthList4 choices10 seconds
Frames a secondList4 choices3 a second
SettingList4 choicesAutomatic (phone-safe on a phone)
Show the originalList2 choicesOff

About it

A video is a string of photos from a moving camera. If the scene stands still, each frame shows it from a slightly different place, and that is enough to rebuild it in 3D. This splash picks the sharpest frames of your stretch, finds the same small details in many of them and works out where the camera was for each one. That is structure from motion. Then it trains 3D Gaussian splats: starting from those points, it nudges each splat's place, size, shape and color until the scene, seen from each camera, looks like that frame.

It all runs on your device's graphics card, and nothing is uploaded. Film by walking slowly around an object or through a place, so the camera moves sideways: 10 to 40 seconds, steady, with texture. Turning on the spot, a tripod, blank walls, sky, water and blur give it nothing to match. On a phone, the phone-safe setting keeps it quick and cool.

Show the original plays the sample's flat video in step with Replay flight.

Details

Your own files
video/*, .mp4, .m4v, .mov, .webm

Limits

WebGPU
Training needs WebGPU. Without it, only the baked samples open.
File size
Up to 40 MB. A larger video is refused.
Time
At High, up to 60 frames and 7,000 training steps, which the tool guesses at 9 to 27 minutes.
Footage
Blank, motionless, and fast-panning clips are all flagged as unlikely to make a clean scene. The flag is an estimate, and Start stays open.

Sources and credits

Libraries

MIT
gifenc 1.0.3
MIT
Splat.js 0.1.0 (lane LSTUDIO, copied from Splashery)

In The Splash Manual

  1. Chapter 10: Make your own
  2. Chapter 8: Photos and video into 3D

Share it

This link opens it in the Playground. To put it on your own page, add the element and one script tag. Every option.

https://splashery.app/play/?toy=video-3d<script type="module" src="https://splashery.app/play/src/element.js"></script> <splashery-toy toy="video-3d"></splashery-toy>

Nearby on the strip