Infinigen has distinct scene generation & rendering stages. We typically run these automatically for you (skip to Generate scenes automatically
First, run ONE command of your choosing from the block below. This will generate a 3D blender file for use in the subsequent steps.
NOTE: fast_solve.gin runs the system for fewer solving steps, which sacrifices quality for speed. Remove t
his to get a more complex & realistic arrangement. You can also remove compose_indoors.terrain_enabled=False to add a realistic terrain background (provided you installed terrain)
# Diningroom, single room only, first person view (~8min CPU runtime)
python -m infinigen_examples.generate_indoors --seed 0 --task coarse --output_folder outputs/indoors/coarse -g fast_solve.gin singleroom.gin -p compose_indoors.terrain_enabled=False restrict_solving.restrict_parent_rooms=\[\"DiningRoom\"\]
# Bathroom, single room only, first person view (~13min CPU runtime)
python -m infinigen_examples.generate_indoors --seed 0 --task coarse --output_folder outputs/indoors/coarse -g fast_solve.gin singleroom.gin -p compose_indoors.terrain_enabled=False restrict_solving.restrict_parent_rooms=\[\"Bathroom\"\]
# Bedroom, single room only, first person view (~10min CPU runtime)
python -m infinigen_examples.generate_indoors --seed 0 --task coarse --output_folder outputs/indoors/coarse -g fast_solve.gin singleroom.gin -p compose_indoors.terrain_enabled=False restrict_solving.restrict_parent_rooms=\[\"Bedroom\"\]
# Kitchen, single room only, first person view (~10min runtime, CPU only)
python -m infinigen_examples.generate_indoors --seed 0 --task coarse --output_folder outputs/indoors/coarse -g fast_solve.gin singleroom.gin -p compose_indoors.terrain_enabled=False restrict_solving.restrict_parent_rooms=\[\"Kitchen\"\]
# LivingRoom, single room only, first person view (~11min runtime, CPU only)
python -m infinigen_examples.generate_indoors --seed 0 --task coarse --output_folder outputs/indoors/coarse -g fast_solve.gin singleroom.gin -p compose_indoors.terrain_enabled=False restrict_solving.restrict_parent_rooms=\[\"LivingRoom\"\]
# Floor layout, overhead view, no objects (~34 second runtime, CPU only):
python -m infinigen_examples.generate_indoors --seed 0 --task coarse --output_folder outputs/indoors/coarse -g no_objects.gin overhead.gin -p compose_indoors.terrain_enabled=False
# Single random room with objects, overhead view (~11min. runtime CPU only):
python -m infinigen_examples.generate_indoors --seed 0 --task coarse --output_folder outputs/indoors/coarse -g fast_solve.gin overhead.gin singleroom.gin -p compose_indoors.terrain_enabled=False restrict_solving.solve_max_rooms=1 compose_indoors.invisible_room_ceilings_enabled=True compose_indoors.restrict_single_supported_roomtype=True
# Whole home with objects, overhead view: # TODO - bring back studio.gin 3-house appartment, for speed
python -m infinigen_examples.generate_indoors --seed 0 --task coarse --output_folder outputs/indoors/coarse -g fast_solve.gin overhead.gin -p compose_indoors.terrain_enabled=FalseNote: whole home solving with objects will take a long time. You can use parallel instances (manage_jobs) below to get more throughput. Reduced roomcount apartment variant coming soon.
Once complete, you can inspect / fly around outputs/indoors/coarse/scene.blend in the blender UI:
python -m infinigen.launch_blender outputs/indoors/coarse/scene.blendYou may be prompted to revisit our Installation.md if blender is not yet installed.
Next, run the commands below to render an RGB image and ground truth:
# Render RGB images
python -m infinigen_examples.generate_indoors --seed 0 --task render --input_folder outputs/indoors/coarse --output_folder outputs/indoors/frames
# Use blender to extract ground-truth (optional)
python -m infinigen_examples.generate_indoors --seed 0 --task render --input_folder outputs/indoors/coarse --output_folder outputs/indoors/frames -p render.render_image_func=@flat/render_image Once complete, you can open outputs/indoors/frames and navigate to view the results.
See ExportingToExternalFileFormats and ExportingToSimulators to export to OBJ/USD.
We also provide an OpenGL-based ground truth extractor which offers additional ground truth channels, read more about using our ground truth here.
To generate a single scene in one command, you can run the following:
python -m infinigen.datagen.manage_jobs --output_folder outputs/my_dataset --num_scenes 1 --pipeline_configs local_256GB.gin monocular.gin blender_gt.gin indoor_background_configs.gin --configs singleroom.gin --pipeline_overrides get_cmd.driver_script='infinigen_examples.generate_indoors' manage_datagen_jobs.num_concurrent=16 --overrides compose_indoors.restrict_single_supported_roomtype=True To create a large dataset of many random rooms, we recommend:
python -m infinigen.datagen.manage_jobs --output_folder outputs/my_dataset --num_scenes 1000 --pipeline_configs local_256GB.gin monocular.gin blender_gt.gin indoor_background_configs.gin --configs singleroom.gin --pipeline_overrides get_cmd.driver_script='infinigen_examples.generate_indoors' manage_datagen_jobs.num_concurrent=16 --overrides compose_indoors.restrict_single_supported_roomtype=True You can inspect outputs/my_dataset/SEED/ to see the running logs of the subprocesses and output results.
See ConfiguringInfinigen.md for documentation on manage_jobs and commandline options.
More documentation coming soon.
Infinigen-Indoors uses large polygons for walls/floors/ceilings by default, which have innaccurate ground truth for the surface normal / minute depth changes created by materials.
To fix this, use real_geometry_with_bump.gin if you want fine mesh + displacements, or just real_geometry.gin if you want the subdivided mesh but no displacement.
blender_gt extracted with cycles. For OpenGL & any non-blender mesh exports, it will be densely subdivided but will not have material displacements applied to the polygons. This is because we use blender's efficient, but non-realized, "shader displacement". We have code to convert this to an exportable mesh (infinigen/tools/convert_displacement.py) but it is not yet integrated
set_displacement_mode.displacement_mode = "NONE" if you want material geometry to be reflected in ground truth.
# install terrain
git submodule update
pip install -e .[terrain]
python -m infinigen_examples.generate_indoors -- --output_folder outputs/indoors/coarse --seed 0 --task coarse -g forest singleroom real_geometry_with_bump -p compose_indoors.terrain_enabled=True restrict_solving.restrict_parent_rooms=\[\"DiningRoom\"\] compose_indoors.solve_small_enabled=False
Second image shows polygons via the following codeblock:
from infinigen.assets.materials.dev import face_size_visualizer as f
f.FaceSizeVisualizer().apply(list(bpy.data.objects))Configuring compose_indoors() and ``restrict_solving()` via gin allows you to only solve sub-parts of the default constraint problem:
python -m infinigen_examples.generate_indoors --seed 0 --task coarse --output_folder outputs/indoors/coarse -g fast_solve -p \
compose_indoors.terrain_enabled=False compose_indoors.solve_medium_enabled=False \
restrict_solving.restrict_parent_rooms=[\"Kitchen\"] \
restrict_solving.restrict_child_primary=[\"KitchenCounter\"] \
restrict_solving.restrict_child_secondary=[\"Sink\"] \
restrict_solving.solve_max_rooms=1 \
restrict_solving.consgraph_filters=[\"counter\",\"sink\"] \
compose_indoors.solve_steps_large=30 compose_indoors.solve_steps_small=30
Each of these commandline args demonstrates a different way in which you can restrict what work the system does:
compose_indoors.terrain_enabled=False compose_indoors.solve_medium_enabled=Falseturns off medium objects (paintings/chairs/ceilinglights) and also terrain. You can use this same pattern to disable anyp.run_stage(name, func, ...)statement found in generate_indoors by specifying fcompose_indoors.{name}_enabled=Falserestrict_solving.solve_max_rooms=1specifies to only solve objects in 1 room of the houserestrict_solving.restrict_parent_rooms=[\"Kitchen\"]specifies to only solve objects in kitchen rooms. You can seeinfinigen/core/tags.pyfor available options.restrict_solving.restrict_child_primary=[\"KitchenCounter\"]specifies that when placing objects directly onto the room, we will only consider placing KitchenCounter objects, not other types of objects. You can seeinfinigen/core/tags.pyfor available options.restrict_solving.restrict_child_secondary=[\"Sink\"]specifies that when placing objects onto other objects, we will only consider placing Sink objects, not other types of objects. You can seeinfinigen/core/tags.pyfor available options.restrict_solving.consgraph_filters=[\"counter\",\"sink\"]says to throw out anyconstraintsorscore_termskeys fromhome_furniture_constraints()that do not containcounterorsinkas substrings, producing a simpler constraint graph.compose_indoors.solve_steps_large=30 compose_indoors.solve_steps_small=30says to spend fewer optimization steps on large/small objects. You can also do the same for medium. These values override the defaults provided infast_solve.ginandinfinigen_examples/configs_indoor/base.gin
These settings are intended for debugging or for generating tailored datasets. If you want more granular control over what assets are used for what purposes, please customize infinigen_examples/constraints/semantics.py which defines this mapping.
If you are using the commands from Creating large datasets you will instead add these configs as --overrides to the end of your command, rather than -p
To enable floating objects in a room, add the override compose_indoors.floating_objs_enabled=True. For example:
python -m infinigen_examples.generate_indoors --seed 0 --task coarse --output_folder outputs/indoors/coarse -g fast_solve.gin singleroom.gin -p compose_indoors.floating_objs_enabled=True compose_indoors.terrain_enabled=False restrict_solving.restrict_parent_rooms=\[\"DiningRoom\"\]
By default, between 15 and 25 objects are generated and have their size normalized to fit within a 0.5m cube. The number of objects can be configured with compose_indoors.num_floating and normalization can be disabled with compose_indoors.norm_floating=False. Collisions/intersections between floating objects and existing solved objects are off by default and can be enabled with compose_indoors.enable_collision_floating=True and compose_indoors.enable_collision_solved=True.
pytest tests/ --disable-warnings
There are times when users would like to generate only the furniture placements given a predefined floor plan. Then the user may run the following command:
python -m infinigen_examples.generate_indoors --seed 0 --task coarse --output_folder outputs/indoors_real/coarse -g singleroom.gin fast_solve.gin no_objects.gin -p compose_indoors.terrain_enabled=False Solver.floor_plan='infinigen_examples/configs_indoor/floor_plans/predefined.json'
python -m infinigen_examples.generate_indoors --seed 0 --task coarse --output_folder outputs/indoors_real/coarse -g singleroom.gin fast_solve.gin no_objects.gin -p compose_indoors.terrain_enabled=False Solver.floor_plan='infinigen_examples.configs_indoor.floor_plans.predefined.example'Inside predefined.json, predefined.py or other similarly specified files, one can specify the rooms, windows, doors as well as open cutters, interior cutters and entrance cutters from their custom dataset. The naming of the room should follow current schema of {room_type}_{room_level}/{room_id}. Rooms are specified as a shapely Polygon, while others are specified as a shapely LineString, either as a shapely geometry or as its REPR string. Open cutters cut off an entire wall from top to bottom, while interior cutters cut off the wall and replace it with a window. The user can also creatively use these methods to build their own floor plan configuration, say, to expose one side of the room to the natural backdrop.