Wallace Wainhouse, product specialist at Epic Games, shows a feature of RealityCapture that is hidden in plain sight: the reporting system, which works as a template translator for any file format. Wallace explains how it powers custom reports, custom exports and conditional automation with RCCMD scripts and the sequencer, and demonstrates a pipeline that seeds a Gaussian splat with a point cloud exported from a RealityCapture mesh.
“Basically, uh, it can be considered to be a template translator, and your template, um, can be anything.”
“So, uh, what I'm trying to say is don't wait for us to build a feature for you.”
“And if only half your camera's aligned, it's a bit of a waste of time meshing it.”
According to Wallace Wainhouse, it is a template translator: you run the export report CLI command with a template in any format, and RealityCapture fills in project data marked with dollar signs.
Yes. Wallace Wainhouse showed RCCMD scripts that align only above a set number of images and mesh only if at least ninety percent of cameras aligned, launched from a custom sequencer button.
Wallace Wainhouse said RCCMD is a simplified version of the CLI, and the help lists all commands when you search for CLI and open the list of all commands.
Transcribed automatically (ElevenLabs Scribe) and lightly edited. It may contain small errors. Click a time to play the video from there.
Wallace Wainhouse: Cheers. Hi there. Yeah, I am-- My name's Wallace Wainhouse, and I'm a product specialist at RealityCapture. And today, I'm gonna talk about, um, a feature which is a little bit hidden in RealityCapture, but hidden in plain sight. Um, some of you will know about it perhaps, um, a bit more superficially.
Wallace Wainhouse: Uh, so, uh, I'm gonna talk to you about the reporting system. And I know it sounds, um, incredibly dull, um, but hopefully by the end of this you'll, um, agree that it's, um, quite a handy, powerful tool. Um, so what might we res-- what, what might we expect from a reporting system? Uh, so these are the built-in reports in RealityCapture. Um, and you might have used them before.
Wallace Wainhouse: And yeah, this is what you would expect from a reporting system, and you can get reports on various things: an overview of your project. Um, you can get some, uh, GIS stuff about your components and some, uh, information about the alignment and orthos and various other stuff. Uh, so what wouldn't you expect from a reporting system? Uh, well, you can export point clouds, models, um, and you can render, um, from any camera in your scene. And I'm gonna go into, uh, some other use cases, which I think you'll agree are quite powerful, um, like conditional automation.
Wallace Wainhouse: Oh. Okay, so what exactly is the reporting system? Now, it might not actually be the best, um, name to describe it as a reporting system, and we might change that at some point because as you'll see later, it's, it's not really just for making reports. So here it is. Basically, uh, it can be considered to be a template translator, and your template, um, can be anything.
Wallace Wainhouse: And you can use those templates by using that CLI command there, export report. And then the first argument is gonna be a path to your report output, and the second argument will be a path to your report template. Um, and you can see this is the-- one of the built-in reports. Um, and it's a HTML template. And if you look out for the stuff with a dollar sign in it, um, that's the stuff which is part of the reporting system, and it's gonna get translated.
Wallace Wainhouse: So for instance, uh, the dollar sign date and time there, and RealityCapture just translates. And when it spits out the report, it'll just have the translated bit. So all the HTML stuff stays the same. And if you look at the stuff that doesn't have a dollar sign in front of it, like RealityCapture, it just stays the same. So it's just gonna be like a normal bit of HTML.
Wallace Wainhouse: Okay, so what can you, uh, do with this? Well, the most basic thing you can imagine is build a custom report. And if you go back to those templates, you can find them in the installation folder. Um, you can go in and edit them and then just add things you like. Now, this is where it gets, um, quite interesting.
Wallace Wainhouse: Uh, conditional automation. So, uh, you can, you can tailor your scripts now, um, for your specific workflows and adapt in the way a human would. So what I'm saying by that is sometimes you will do the same thing in specific situations when you're working in RealityCapture. So you'll be like, "If this is the state of my project, then I always do this." And obviously that's a great way, uh, to automate.
Wallace Wainhouse: Um, and the other thing is custom export. Um, so you can do a bit of both. Um, and if any of you are familiar with our COLMAP exporter, that was actually built using the reporting system. And, uh, if you're familiar with our mobile, um, application, RealityScan, quite a lot of that is also built with, with the reporting system. So it's super powerful.
Wallace Wainhouse: So, uh, what I'm trying to say is don't wait for us to build a feature for you. You might be able to actually build it yourself 'cause this is a really, really powerful way of, uh, scripting. So what kind of formats are possible? I mean, I've given some examples here, but basically it is, uh, anything really. So I've got, um, Python there and a batch.
Wallace Wainhouse: And you can see, I mean, for example with the batch script there, if you use these set commands, that can just be run as a bat after it's been translated. And you'll get those variables there, which you can then use in, in CLI. And, uh, this is a fun one here, um, which is gonna be in one of my examples here. We can actually create a PLY point cloud. And you can see...
Wallace Wainhouse: Oh, actually I'll, I'll get into more details with that later. Okay. So what kind of data can we get from RealityCapture? Uh, so these are the basics: uh, camera data, location, orientation, intrinsics, model data, uh, geometry. You can get like the number of triangles and stuff like that.
Wallace Wainhouse: And anything about the texture, like how many textures and, uh, what detail they're in. Uh, orthos and anything you can see in the GUI, basically. Uh, so I'm gonna do some examples now. Um, and I'm not saying, like, this is actually what you should do with it, but it's just gonna give you an idea. 'Cause the way to actually use this is to specifically tailor it to your needs and what you do on a daily basis, 'cause it's gonna be very, very unique.
Wallace Wainhouse: Uh, so my first example is gonna be quite similar to our Start button, but including some, uh, conditions. So we'll align, but only if we have a certain number of cameras, and we'll mesh, but only if a certain percentage of cameras have aligned. And you can imagine that's quite useful 'cause I, I can imagine that some of you here have probably got your computers chugging away at home whilst you're sitting here. And if only half your camera's aligned, it's a bit of a waste of time meshing it. So, you know, your script could then move on to the next project and actually mesh something which is gonna give you a model which is of value at the end.
Wallace Wainhouse: And we're gonna have no condition for texturing. In fact, I'm just gonna miss that bit out. And to do this, we're gonna use the sequencer. I'm gonna explain what that is in a sec. And we're gonna use RCCMD, um, which I'll also explain in a second.
Wallace Wainhouse: It's RealityCapture's own scripting language. Okay, so what is RCCMD? Uh, RCCMD is RealityCapture's own scripting language, and you can run the scripts by dragging and dropping them into RealityCapture, or you can use this command here. And, uh, normally, we don't disclose anything in our roadmap, but today, um, this isn't the biggest feature in our next release. But I can tell you that in the next release, RCCMDs will translate anything which uses anything from the reporting system, um, instantly.
Wallace Wainhouse: Uh, it's not something you couldn't do before, but it's gonna be a lot easier now. Before, you'd have to make a template of an RCCMD and then, um, and then translate it essentially in the method that I showed you before. But now, it'll instantly be translated. So, what is the sequencer? If you're not familiar with RealityCapture, this is the UI, uh, not the most beautiful in the world.
Wallace Wainhouse: Um, and you can make a console window here, and, uh, you can actually write commands straight in. So you just write in whatever commands you like, um, and, uh, and then it will run them. But the other thing you can do is you can press that button there, that plus button, and then you can save all the commands in your sequence, and it will actually put your own custom button in the GUI there. Um, this, uh, command here, exec RCCMD, which is how we run an RCCMD, and then you just put a path to it, and that's the one actually we're gonna be using in our example. So it's just got a path to master start.
Wallace Wainhouse: rccmd, which we'll have a look at now. Uh, so here is my master start RCCMD, and it's not very sophisticated. All it does is it has t- three more exec RCCMD commands with the paths to those RCCMDs. So let's have a look at this one using the reporting system. So here's an RCCMD, and you can see the-- If you're familiar with our normal CLI commands, they're quite basic.
Wallace Wainhouse: So to align, it is just hyphen align. Everything else is the reporting system, so it's very simple. Uh, if there's more than fifty images in, um, in your project, then it'll align. I can't imagine anybody using that, but, um, I just wanted to make a very simple example to start with. Uh, and so next, we have the, uh, mesh start.
Wallace Wainhouse: Now, this is the one which is actually quite useful. And we have, uh, these, these two variables here. We've got component camera count divided by image count is greater than or equal to point nine. So it's only gonna mesh if ninety percent of your cameras are aligned. Okay.
Wallace Wainhouse: So, uh, I had to crowbar, uh, Gaussian splats into here somehow because they're, they're all the rage these days. Uh, so I'm gonna show you an example of how to make a Gaussian splat. That is, um, that is not just a photo. That is a Gaussian splat. I probably should have done a bit of video to sh- demonstrate that it is.
Wallace Wainhouse: That's an orchid from my kitchen in front of my computer monitor, uh, so in Unreal Engine. Okay, so what files do we need for a splat? Uh, we need, um, an alignment. We're not gonna be using the reporting system there. It's just a regular CLI export.
Wallace Wainhouse: Um, and the PLY point cloud, which I showed you earlier. Um, and in this case, I've got a Python script which actually hard masks the RealityCapture masks, um, onto the original images, so they're baked in there. So this is the, um, PLY thing, which I thought was fun. If you're familiar with splats, you'll know that actually the longer you train, the less relevant, uh, your sparse point cloud is. But I figured, "Hey, why not actually seed those splats exactly where you actually want the object?"
Wallace Wainhouse: Um, so in the script, the-- it just has a normal simplify command, and then we can use this function here from the reporting system, iterate mesh vertices, and it will just go through all of the vertices and, um, save their positions in the PLY format, which we can have a look at i-in a second. So here is my, um, my report for the PLY exporter. Um, and you can see the header. Basically, I just, uh, like... Well, let's have a look.
Wallace Wainhouse: Which one's the actual final one? Uh, I just copied- I actually exported our sparse point cloud PLY and just copied the header, um, straight out of it. Um, and then you can see where the reporting system is being used here. So in element vertex there, we have, we have to special-- um, specify which function set we're using, um, and then we use export models. And you can see I've got an if condition there as well to make sure the model's called for splat.
Wallace Wainhouse: So earlier in the script, I renamed the model for splat because that export model function is an iterator. So it's actually gonna iterate through all of your models, and you don't particularly want to have all the vertices listed for every single model there. You just want it for the one, um, that you actually want. Uh, and again, at the bottom here, uh, we have, um, a function to actually list those, uh, those vertices there. And what, what we have here is, um, in iterate mesh vertices, we have the X, the Y, and the Z, and we have the three colors RGB.
Wallace Wainhouse: And you might notice that actually it's being written in binary here, so this is a binary, um, PLY, and we ha-- we can specify the format here. So if you look on the X, we have a-- after the colon, we've got B for binary and then F for float. And so our X, Y, and Z are binary floats, and our colors, um, are C is for unsigned character, so they're bytes. So again, we've got binary, uh, byte, byte, byte, um, and it just lists it. And that's what a PLY is.
Wallace Wainhouse: And, um, uh, there's a QR code at the end, um, which goes to, uh, a tutorial I have which shows you how to do the ASCII version of this, which is easier to have a look 'cause you can actually see all of the data written below. But if you wanna do it in binary, that's how you do it. Um, okay, so let's have a look at the whole pipeline. Uh, so we make a button in the GUI, how I showed you earlier with the sequencer, and that's gonna ex-ex-execute two, um, RCCMDs. One is splat RCCMD, and one is Python masker RCCMD.
Wallace Wainhouse: And the splat one will simplify export alignment, export the masks from the mesh model, by the way, um, which makes these masks here, um, and export, uh, the point cloud, which was the PLY exporter we showed earlier. Um, and the Python masker one, um, actually launches a batch which uses se-- uh, which uses shell execute to launch a batch, which then in turn launches the Python, um, which will just multiply that image by that image and give you your masked image at the end. Uh, so here it is in action. Um, there's my masked inputs, and there is my splat being seeded by the, um, dense mesh, um, not the sparse mesh. Um, uh, and okay.
Wallace Wainhouse: So in summary, uh, what can you do with the reporting system? Um, you can make a report template, um, in any file, file format. Uh, you, you can add any information from your project to that file. RCCMD will soon, uh, use the entire reporting system, and you can tailor automation to your specific workflows. And that's everything.
Wallace Wainhouse: And that, uh, that QR code there, uh, will link to my tutorial, um, on the reporting system. There's two parts to it. Um, so yeah, if you wanna reproduce this, then check it out.
Host: Let's give it up for Wallace. Wallace, thank you so much for guiding us through. Really convenient that you put up the QR code for the tutorial for people. I saw a lot of people scanning that, which is fantastic. Quick question.
Host: We've got a few that came through. So the first one: Do you have any tutorials on how to use your programming language? Was that the one on the QR code?
Wallace Wainhouse: Uh, RCCMD?
Host: Uh, I think so, yeah.
Wallace Wainhouse: No. Oh, oh, the-- Are we talking about the reporting sy-- Oh, I don't know if... Uh, the-- I think the programming language is RCCMD, but yeah, there's many on CLI, and basically it's a simplified version of, of CLI. So in CLI, you have to have a path to your RealityCapture installation, but with RCCMD, you simply just write out your commands. And if you look in our help, there's like extensive, um, like documentation of all of our commands.
Wallace Wainhouse: If you just type in CLI into, um, help and then go to, um, list all commands, then you'll find all of the commands there.
Host: Perfect. Awesome stuff. Let's take, uh, uh, let's take the remaining two, which are really short. Will your program remain free in the future?
Wallace Wainhouse: Oof, I can't answer questions like that, but I would have thought so.
Host: Okay.
Wallace Wainhouse: I can only guess. I, I, I haven't heard anything otherwise.
Host: Oh, okay. But thank you so much for being honest. It's totally okay. Let's take one last question. Is there a limit for the length of the custom script/code in RealityCapture?
Wallace Wainhouse: Not that I know of. Um, so I imagine, yeah, I, I, I don't know of one, but I haven't, I haven't tested that. So I hate saying yes to questions like that, but maybe if you wrote like a million lines of code, it would probably, uh, explode.
Host: Thank you so much for your honesty. Let's give it up for Wallace one more time, ladies and gentlemen. Cool.

Product Specialist at Epic Games
Originally an art school graduate, Wallace then ventured into freelance multimedia content creation, combining his artistic background with technical skills in graphic design, 3D animation, and videography. For the past four years, he has been an integral member of the product team at…