rallyforthesun's comments

On: ChatGPT Saved Chats: Save and organize your import...

[rallyforthesun]

I learned today, that o-1 is able to search through all chats and can find and verify if the findings are relevant to the actual context. i found that very usefull as i have a lot of very long chats regarding only one project. ChatGpt lists the findings with the date and context and searches further back if asked for it. (in my case summer 2024)

[graeme → rallyforthesun]

Wait, how do you do that?

[rallyforthesun → graeme]

I did just ask to remember from our last chats, if we hadn’t this particular bug discussed before.

On: 3D Convex Splatting: Radiance Field Rendering with...

[rallyforthesun]

This method is promising, especially with flat and untextured surfaces. Secondly, this method has far better detailed results in the background. (compared to 3d Gaussian Splatting)

On: Show HN: SuperSplat – open-source 3D Gaussian Spla...

[rallyforthesun]

You are right, that many features in game engines cannot be used yet, especially relighting and reflections. But there are cases where game engines (like Unreal Engine 5) are used, for example in Virtual Production with Ledscreens, where a photorealistic background is needed (3d gaussians do look more realistic and are cheaper to produce than a comparable scene made of polygons)

Supersplat is actually a game engine (but for the web)

On: Show HN: SuperSplat – open-source 3D Gaussian Spla...

[rallyforthesun]

This looks like a promising tool to (also) generate completely generative 4d Multiviews which then can be used to generate 3D-GS, their pipeline also supports animated objects, camera zoom and pan. They do benchmark their results with 3D GS. The code is unfortunately not yet published, cant wait to try it. https://gen-x-d.github.io/

On: Brush – A new compatible Gaussian splatting engine

[rallyforthesun]

Thank you for releasing this. It is the first option afaik, to generate a 3D Gaussian on a Mac without a gpu (using M1 Pro). It is quite slow, but quick enough to test-train a dataset while onsite, without the need to carry heavy workstations around! I really like the option to use rerun.io for training analytics. Again, thank you.

[ArthurBrussee → rallyforthesun]

You're welcome and thank you for trying it out!

Hard at work to make performance better - the "main" kernels are at least as fast as gSplat, so now need to remove other overheads.

That, and make splatting train more efficiently in general, lots of compute is wasted on small steps.

Ps: the web version takes a minute to warm up and is generally slower, do try a native version if you haven't yet!

[rallyforthesun → ArthurBrussee]

Thanks for the advice, i did compile the repo on my m1 using vs code, but i do compare the speed to my workstation RTX4090, that comparison is not appropriate.

On: Brush – A new compatible Gaussian splatting engine

[rallyforthesun]

you could also use Metashape

[andybak → rallyforthesun]

Or Reality Capture which I think can do it for free?

[rallyforthesun → andybak]

In metashape, you can export the cameras in the colmap format, in RC you might have to convert first to Kapture and so on, afaik.

On: Brush – A new compatible Gaussian splatting engine

[rallyforthesun]

no, it expects a zip file with already aligned images (for training) or the pointcloud itself (for viewing)

On: Adobe Firefly use of 3D Gaussian Splatting

[rallyforthesun]

Adobe Firefly uses 3D Gaussian Splatting for 3D representation. This is one of the probably unrecognized use cases where this still quite new tech blends into a product, without being the product itself.

This is one of my first posts here, please remove it if i does violate a rule.

On: DJI ban passes the House and moves on to the Senat...

[rallyforthesun]

That someone can buy new DJI drones in europe is right, but only the latest releases. You cannot use any of the drones you might have purchased over the last years anymore in europe because of the new regulations.

[coldtea → rallyforthesun]

I don't think that's true. You just need some new firmware or something, no?

On: Level of Gaussians: Real-Time View Synthesis for M...

[rallyforthesun]

Thanks for pointing out the challenges with gaussian splattings. Are there any AI based relighting methods out there? Some prompt based editing like nerf2nerf or Language-embedded NerFs maybe?