John Ristevski, CEO of the nonprofit CyArk, explains how CyArk moved from archiving 3D data of heritage sites to telling stories about them with Tapestry, a free web and mobile platform that layers narrative, voices and media on a 3D canvas. Three case studies show the range: the Ad Deir Monastery in Petra, lunar heritage sites on the Moon, and Pompeii and Civita di Bagnoregio captured as Gaussian splats with a 360-degree drone.
“We started by documenting spaces, you know, documenting 3D environments, and I think we've really migrated to thinking about these sites as places.”
“it leads to a real, um, ownership of the product once it's created if they've had a hand in creating it themselves.”
“After taking a tapestry tour, about 83%, uh, expressed increased interest in the place or wanted to visit it.”
John described Tapestry as CyArk's free storytelling platform for web and mobile that uses 3D data as the canvas for 10 to 30-minute guided experiences; 67 have been published from 37 countries in 15 languages.
According to John, individual views are extracted from the 360 video and fed into the Gaussian splatting pipeline, with Postshot used for training.
John said CyArk occasionally partners with local entities for data collection; it is rare because CyArk follows its own methodology, but it is open to talking.
Transcribed automatically (ElevenLabs Scribe) and lightly edited. It may contain small errors. Click a time to play the video from there.
John Ristevski: Thank you. Great. Okay. Firstly, uh, thank you to Tomas and Michal for inviting me here to Prague to speak to you all about storytelling in 3D and our experience connecting people, place, and reality capture. Um, I wanted to start with just a, a brief introduction to the organization I represent.
John Ristevski: Uh, we're called CyArk. We're a nonprofit located in the San Francisco Bay Area in California, and we've been operating for over 20 years. We were founded in 2003 in the very early days of, uh, of 3D scanning. And over that time we've been, uh, we've worked in over 50 countries, we've completed over 350 projects, and as the technology has changed, so, so have we. Um, and our mission today is really focused on making the world's heritage accessible for, uh, both audiences today, but also for future generations.
John Ristevski: And I wanted to start with a short video that explains a little bit of our journey, where we've come from and where we're going to.
Video: I was born in what today is Mosul, Iraq, but was Nineveh in those days, the capital of the Assyrian Empire. I remember my dad used to take me by the hand to go out on weekends and go visit the winged bulls which guarded the gates of Nineveh. I was maybe six, seven years old, and those memories have continued to be with me over the years. What inspired my wife Barbara and I to get started on what today is CyArk was, uh, the events, uh, that took place around 2000 when Cyra Technology Company had been acquired, and right about then, the Bamiyan Buddhas were destroyed in Afghanistan. I mean, they were just gone.
Video: The, the world lost them forever. We felt that we needed to do something to get the technology we had developed as part of Cyra Technologies into the hands of preservationists to digitally preserve world heritage sites.
John Ristevski: Our evolution at CyArk has really been an interesting one. We started by documenting spaces, you know, documenting 3D environments, and I think we've really migrated to thinking about these sites as places. More than just like the physicality of the, the 3D structures, but incorporating the stories and the people and the history of these places into really what we call a place-based experience, combining all of that into a rich and powerful narrative that we can share with the world. At the center of our values is really an approach that incorporates openness and collaboration, and you can see that reflected in our work. Working with the communities that are connected to these places to understand their problems, and collaboration is gonna be key for us to ensure that working with our partners is a success.
John Ristevski: So we, we started off really as an archive for 3D data, but that has changed over time, and we've tried to make that data much more accessible to a general audience. And we've kind of brought all that together in the last few years with our Tapestry platform, which is a storytelling platform for web and mobile devices that, uh, takes 3D data as the kinda canvas and, uh, layers stories on top of it. So they're generally 10 to 30-minute experiences that are freely available to the public, and I'm gonna show you a few examples today about the platform and some case studies to, to illustrate it. Um, firstly about the platform itself. It-- there's kind of five key layers that we weave into the experience, and the kind of foundational layer for that is the 3D data, or what we call the 3D canvas, which is our spatial storytelling canvas that the user is guided through in the journey.
John Ristevski: And on top of that, we have a structured narrative, so key stops within the 3D environment that the user can visit, hear narration, hear a story. And then at those stops, they can also access other information, a key one being voices. And so these are first-person perspectives, usually interviews conducted by us on site with community members, experts, uh, conservators, site managers, people that can provide an interesting perspective on the story. And then they can also access media, so this might be historical photographs, other imagery, uh, maps, historical documents, things that relate to the story. And then in addition to the structured narrative, we also have interactive moments for exploration, so parts of the model that the user can explore or dive deeper in.
John Ristevski: Um, and I'll, I'll illustrate this through three examples. I'll take you on a little journey today to three different locations, a site in Jordan, a site in Italy, and one much further away on the Moon, looking at, uh, lunar heritage. Um, the first one I'll start with is our work in, uh, Petra. Um, so we were able to work at the Ad Deir Monastery, which is one of the most- Uh, iconic sites in Petra. Um, you, you might know this location.
John Ristevski: Um, this was a collaborative project with the Petra National Trust, um, who is one of the, the key organizations in Jordan responsible for, uh, promoting and caring for Jordanian heritage. And so together, we were interested in telling a story about this monument and bringing it to an audience, not just within Jordan, but around the world. So we were able to use lidar and photogrammetry in this case, but also incorporate interviews with a lot of key, um, community members, including a local tour guide, um, a historian, uh, a government official, and, you know, that would provide different perspectives for users to hear from along the journey. So we published this late last year, and, um, and the Petra National Trust is in the process of rolling this out to, uh, teachers in Jordan as an educational resource. The second project I'll talk about is our project looking at lunar heritage, which is like might be one of our more unusual projects.
John Ristevski: Um, and by lunar heritage, I mean the artifacts and technology left by humankind on the Moon from past missions and from crash sites. And our partners on this project were the World Monuments Fund and, uh, ICOMOS. And World Monuments Fund has a, uh, what they call a watchlist. It's like an endangered list for cultural heritage, and the Moon made it on this list for twenty twenty-six. And, uh, as you can probably guess, this is, like, hard to visualize, hard to experience.
John Ristevski: No one can go there. No one can even see what really exists on the Moon today. It's kind of very intangible and abstract. So unlike many of our projects, this did not involve any direct reality capture. We were able to use, uh, terrain data from NASA to visualize the Moon at the planetary scale via Cesium.
John Ristevski: And we also hand-modeled a bunch of, uh, the landing sites, including Apollo 11, Apollo 17, and a Soviet landing site, uh, which was the first, um, autonomous rover, so using historical documents and consulting with archeologists. So I'm gonna play another short video that gives you a little flavor for this, uh, interesting project.
Video: We as a human species have wanted to go to the Moon for a long time.
Video: Three, two, one. We have a liftoff and liftoff of Apollo 11.
Video: Lunar heritage is the footprints on the Moon, the iconic rover tracks on the Moon, and there's probably in excess of three hundred and fifty metric tons of cultural material on the lunar surface. In what sense Tranquility Base, apart from other locations, is it the first time humans had gone to another celestial body and landed there?
Video: The Eagle has landed. Roger, Twank-Tranquility. We copy you on the ground.
Video: There are many remarkable objects up there, from the lunar rovers to the scientific packages and even the Apollo crew plaques. When I flew into space in, uh, nineteen eighty-one, human spaceflights were essentially a governmental activity led by two blocks. Uh, today, uh, we're witnessing a transformation. More traffic, more actors, and new legal and ethical questions about resources, safety, and heritage protection.
Video: World Monument Watch's recognition of Tranquility Base as a site of endangered nature is a very timely declaration of the critical importance of protecting aerospace heritage sites.
Video: I'm gonna step off the LM now. That's one small step for man, one giant leap for mankind.
Video: I believe that the Moon is an extraordinary place. It's owned by no one and it's owned by everyone. The Moon serves for the benefit of humankind. It is meant to be shared and protected by all of Earth's inhabitants.
John Ristevski: So I'd encourage you all to check that one out. It's a, it's a really unique one. The final case study I wanna look at today is one of our re- very recent projects, launched just a couple of weeks ago. Um, two sites in Italy, uh, the Forum at Pompeii and Civita di Bagnoregio, which is a hilltop town in northern Italy. Um, this was a partnership with Antigravity, the drone maker that has the new three-sixty-degree video drone, the Antigravity A1, which we used to do, uh, data capture on this project.
John Ristevski: Um, very interesting project for us in, in a number of ways. Uh, it was our first, um, SPLAT-based, uh, or SPLAT-processed, uh, capture that we've ever done. And our first splat tapestry, and our first use of a, uh, 360-degree video drone. Um, so we were able to spend, uh, a very limited amount of time on site for these, uh, projects. We had, uh, permits, gave us about two hours of data capture for each site, and we threw the-- flew the Antigravity A1 drone and were able to capture that, um, about an hour's worth of video content.
John Ristevski: And that was, uh, processed, um, into a splat, and then that, uh, became the kind of 3D canvas for the two different tapestries, um, that we were able to produce. And, uh, this is part of Antigravity's Project Eternal, which is a initiative they've created to encourage use of 360 video for, um, heritage capture. Um, if you go to their website, they have a challenge right now that you can enter if you have a 360 video capture device, if you wanna, um, contribute something to this, uh, Project Eternal, um, program that they've created. Uh, these three experiences are three of 67 that we've published on the platform over two years since launch. Uh, they represent stories from 37 countries, five continents, and, uh, they-- those, um, experiences are available in 15 different languages.
John Ristevski: Um, a little bit about the workflow behind each of these 67 experiences. They essentially fall into three different, uh, categories. The first two are pr- are really our bread and butter at CyArk, uh, which is a photogrammetry-only capture. And then the second one, a photogrammetry plus LiDAR. This is what we've been doing for, for 10 or more years.
John Ristevski: And now the third one that we've been introducing with these, um, Italian sites is a, a splat-based capture. Um, we also have, uh, access to a PortalCam as well that we're experimenting with that might also eventually be part of our, uh, capture methodology. On the presentation side, like in terms of how we present this data on the web in a fast and efficient way, we kind of have a multimodal strategy with our, uh, 3D engines. Um, we were deploying three in, uh, um, in conjunction, uh, the first being a custom Three.js engine, which delivers, uh, curated, uh, GLB models that are already hand-optimized and, um, sized correctly for web delivery.
John Ristevski: We're also utilizing the, uh, 3D Tiles specification and CesiumJS to deliver very high resolution, uh, 3D data across the web. And then finally, for that, uh, first splat, uh, tapestry, we're utilizing the PlayCanvas, uh, engine and PlayCanvas' um, LOD streaming format for delivering high-resolution splats over the web. Um, another aspect of is our in community engagement piece, and we kind of have two different modes w-with how we work with communities. The first being our kind of standard, which is a CyArk-led process, where we consult with the community about what they would like out of the story. We include them as part of the, the voices and, and interview experiences.
John Ristevski: But we essentially manage the storyboarding, scripting, and interviews. The second one, which is maybe more interesting and, uh, requires a much, much deeper collaboration with the community, is a community-made model, which is a true- truly collaborative, uh, co-creation. So we, uh, teach them how to write the script, we teach them how to conduct interviews, and they truly co-create the experience with us. Um, it involves training, it involves, uh, knowledge transfer, and we like it in many aspects, especially because it leads to a real, um, ownership of the product once it's created if they've had a hand in creating it themselves. And I'll, I'll wrap up with some, uh, numbers here.
John Ristevski: So two years, uh, after launch of our platform, we're averaging about a quarter million, uh, users per year that are taking tapestry tours. They're spending on average about five minutes, uh, per experience, um, which might sound small, but actually for a web-based experience is pretty great. Um, and that tends to be much, much, much higher when they're using it in the classroom. So we have a survey at the end of the tapestry, and we ask them, uh, how-- why they used it and how they found it. So about 30% of users are actually using this as part of a classroom activity or a classroom assignment.
John Ristevski: And then the final number on the end there is, uh, a number that's important to our partners. After taking a tapestry tour, about 83%, uh, expressed increased interest in the place or wanted to visit it. And I think that's building that, uh, curiosity and engagement around these sites, and that's w- exactly what our partners at these sites wanna see. Um, and that's it. Thank you.
John Ristevski: Check out Tapestry, tapestry.cyark.org.
Host: Let's give it up for John. Incredible.
John Ristevski: Thank you.
Host: Incredible stories, incredible projects. Let's take a look at the questions from the audience, starting off, uh, with the first one. So you showed us a multi-camera view from the Antigravity. Is this extracted from a spherical 360 image, or do you get individual camera views out of it?
John Ristevski: We do. We do. I d- I think that was more of a marketing graphic, but we do extract, uh, individual views from the 360 image that then get fed into the Gaussian splatting pipeline.
Host: Mm-hmm. Thank you so much. Next one: Can companies and individuals with equipment and the desire to document places join these nonprofit projects? Uh, how can they support them?
John Ristevski: Oc-occasionally we do.
Host: Mm-hmm.
John Ristevski: We occasionally will partner with a local entity to do data collection or do data collection with them. It's a b- little bit rare for us 'cause we have our own methodology that we follow, but we're, we're open to talking.
Host: Mm-hmm. In what software did you process the 360 video data? Um, what is the main difference between 2D and 3D capture?
John Ristevski: The-- For this Gaussian splatting, we use Postshot, uh, for the actual, uh, training. That's, that's probably... Yeah. Happy to chat more if whoever asked that question wants to come up and-
Host: Perfect. Well, you showed us the project of the moon heritage. Are you planning on working with the current moon missions, such as the Artemis program?
John Ristevski: Oh, that would be very cool. But no, no plans yet. But-
Host: Oh
John Ristevski: uh, hopefully the Artemis mission is inspiring more curiosity. But it worked out well that we launched that almost at the same time 'cause people seem to be more curious about what's happening on the moon.
Host: Very cool. Um, thank you. Your tutorial from five years ago was, uh, what got me into heritage photogrammetry, which is really awesome. Yossi, can you raise your hand?
Video: Here. Here.
Host: Oh, perfect. Okay, let's give it up.
John Ristevski: I'm, I'm glad. Yeah. Uh, like, people seem to find these resources that we put out there, and we still do trainings. We have a, um, a grant program for, uh, training, uh, that we offer to, uh, people worldwide. We have, like, uh, two rounds a year and 10% participants per program, per program.
John Ristevski: So keep an eye out from that. And we also offer paid, uh, trainings as well.
Host: Perfect. Ladies and gentlemen, let's give it up for John Ristevski once again.
John Ristevski: Thanks.
Host: John, thank you so much.

Chairman of the Board and CEO of CyArk
John is formerly the Vice President of Reality Capture and Processing at Nokia’s mapping company, HERE, where he led the company’s initiative to index reality. John joined HERE in 2012 through the acquisition of his company, earthmine, which developed systems to capture and deliver highly accurate…