LocalMesh Single-Photo Splat-to-PBR-Mesh

A single photograph is lifted directly to a navigable 3D Gaussian splat by a feed-forward image-to-splat model, then a bundled local stack of a monocular geometry model, an inpainter, and material-decomposition models carves that splat into a textured, PBR-mapped quad mesh, all running on the user's own GPU with nothing uploaded to a server.

Properties

family: 3d
modality: single photo -> 3D Gaussian splat -> carved mesh -> PBR-textured mesh
whyMultiModel: The vendor's own model-download list names six distinct component checkpoints (TripoSplat, MoGe-2, LaMa, IDArb, a Stable Diffusion 2.1 base, and SuperMat) that together turn one photo into a full PBR mesh, a task no single one of them performs alone: TripoSplat only produces an untextured, unfused Gaussian splat with no solid surface; MoGe-2 is a monocular geometry/depth estimator with no material or splat capability; LaMa and the SD 2.1-based pass are inpainting models with no 3D or material understanding; and IDArb/SuperMat are dedicated PBR material-decomposition models that require an already-complete texture to decompose. Note: LocalMesh's page lists these six checkpoints as the bundled model stack but does not spell out the exact stage-by-stage wiring; the specific role assigned to each model below (geometry vs. inpaint vs. material) is inferred from each model's independently documented purpose (TripoSplat = image-to-splat, MoGe-2 = monocular depth/normals, LaMa = inpainting, IDArb/SuperMat = PBR decomposition), not stated verbatim by the vendor.
steps: [object Object], [object Object], [object Object] +1 more
controls: capture angle and quality of the single input photo, splat point budget, mesh export format (OBJ/GLB) versus raw splat export (PLY), which PBR maps to export
exampleStack: TripoSplat (photo -> splat) -> MoGe-2 (geometry) -> mesh carve -> LaMa + Stable Diffusion 2.1 (texture completion) -> IDArb + SuperMat (PBR decomposition) -> OBJ/GLB export, entirely local on one GPU
useCases: [Offline, privacy-sensitive single-photo 3D asset capture for game or VFX props][Rapid PBR-ready mesh creation from a single product or object photo without a photogrammetry rig][Local 3D scanning where uploading source photos to a cloud service is undesirable]
pitfalls: Single-photo capture means unseen sides of the object are inpainted or hallucinated rather than truly reconstructed; PBR decomposition quality depends entirely on how well the inpainting stage completed occluded regions; requires a local NVIDIA GPU with at least 8GB VRAM; the vendor does not publish a technical writeup of the exact stage order, so the mechanism above is a reasoned inference from each bundled model's known purpose, not a confirmed architecture diagram.
source: LocalMesh: Turn photographs into textured 3D models, entirely on your own machine (product site, model bundle list)

Provenance

Source: https://local-mesh.com/

LocalMesh Single-Photo Splat-to-PBR-Mesh

Properties

family

modality

single photo -> 3D Gaussian splat -> carved mesh -> PBR-textured mesh

whyMultiModel

The vendor's own model-download list names six distinct component checkpoints (TripoSplat, MoGe-2, LaMa, IDArb, a Stable Diffusion 2.1 base, and SuperMat) that together turn one photo into a full PBR mesh, a task no single one of them performs alone: TripoSplat only produces an untextured, unfused Gaussian splat with no solid surface; MoGe-2 is a monocular geometry/depth estimator with no material or splat capability; LaMa and the SD 2.1-based pass are inpainting models with no 3D or material understanding; and IDArb/SuperMat are dedicated PBR material-decomposition models that require an already-complete texture to decompose. Note: LocalMesh's page lists these six checkpoints as the bundled model stack but does not spell out the exact stage-by-stage wiring; the specific role assigned to each model below (geometry vs. inpaint vs. material) is inferred from each model's independently documented purpose (TripoSplat = image-to-splat, MoGe-2 = monocular depth/normals, LaMa = inpainting, IDArb/SuperMat = PBR decomposition), not stated verbatim by the vendor.

steps

[object Object], [object Object], [object Object] +1 more

controls

capture angle and quality of the single input photo, splat point budget, mesh export format (OBJ/GLB) versus raw splat export (PLY), which PBR maps to export

exampleStack

TripoSplat (photo -> splat) -> MoGe-2 (geometry) -> mesh carve -> LaMa + Stable Diffusion 2.1 (texture completion) -> IDArb + SuperMat (PBR decomposition) -> OBJ/GLB export, entirely local on one GPU

useCases

[Offline, privacy-sensitive single-photo 3D asset capture for game or VFX props][Rapid PBR-ready mesh creation from a single product or object photo without a photogrammetry rig][Local 3D scanning where uploading source photos to a cloud service is undesirable]

pitfalls

Single-photo capture means unseen sides of the object are inpainted or hallucinated rather than truly reconstructed; PBR decomposition quality depends entirely on how well the inpainting stage completed occluded regions; requires a local NVIDIA GPU with at least 8GB VRAM; the vendor does not publish a technical writeup of the exact stage order, so the mechanism above is a reasoned inference from each bundled model's known purpose, not a confirmed architecture diagram.

source

LocalMesh: Turn photographs into textured 3D models, entirely on your own machine (product site, model bundle list)