IRC log of immersive-web on 2023-09-11

Timestamps are in UTC.

12:35:32 [RRSAgent]
RRSAgent has joined #immersive-web
12:35:36 [RRSAgent]
logging to https://www.w3.org/2023/09/11-immersive-web-irc
12:35:43 [cwilso]
zakim, this is Immersive Web
12:35:44 [Zakim]
got it, cwilso
12:35:48 [myles__]
present+ myles
12:35:54 [ada]
present+
12:35:59 [bkardell_]
present+
12:35:59 [cabanier]
present+
12:35:59 [cwilso]
scribenick: bkardell_
12:36:04 [cwilso]
present+
12:36:09 [bialpio]
present+ Piotr_Bialecki
12:36:09 [cabanier]
scribenick: bkardell_
12:36:12 [atsushi]
rrsagent, make log public
12:36:13 [alcooper]
present+
12:36:14 [Brandel]
present+
12:36:45 [myles___]
myles___ has joined #immersive-web
12:38:10 [takashi_m]
takashi_m has joined #immersive-web
12:38:10 [ntim]
present+
12:38:10 [takashi_m]
present+
12:39:15 [Maud]
Maud has joined #immersive-web
12:39:15 [sangwhan]
sangwhan has joined #immersive-web
12:41:04 [ada]
test
12:41:04 [ada]
s/test//
12:41:04 [atsushi]
rrsagent, publish minutes
12:41:35 [RRSAgent]
I have made the request to generate https://www.w3.org/2023/09/11-immersive-web-minutes.html atsushi
12:41:44 [bkardell_]
ada: Real World Meshing and Real World Geometry, maybe we can move from the CG to the WG
12:41:44 [alcooper_]
alcooper_ has joined #immersive-web
12:41:44 [mfoltzgoogle]
present+ Mark_Foltz
12:41:44 [Jesse_Jurman]
Jesse_Jurman has joined #immersive-web
12:41:46 [bkardell_]
ada: WebXR web GPU Binding? We'll have to check into that one
12:42:37 [dino]
present+
12:42:43 [atsushi]
agenda: https://github.com/immersive-web/administrivia/tree/main/TPAC-2023#agenda
12:42:49 [bradleyn]
bradleyn has joined #immersive-web
12:42:54 [bkardell_]
ada: Some of the other CG topics we have - I'm not sure, I'll do a quick list and you can q+ .... capture, computer vision, detached elements, front-facing camera, geo-alignment, marker tracking,
12:44:11 [bkardell_]
ada: the hololens... I'm not sure if they are supporting WebXR anymore - that was one blocker in the past, what they supported. It broke and we're not sure what the plans are with it.
12:44:11 [ada]
q?
12:45:01 [bkardell_]
ada: for now lets move that in CG. <model> is still being active. Nagivation, occlusion, raw camera access... is that out behind a flag in chrome
12:45:14 [bkardell_]
bialpio: it is enabled by default
12:45:23 [bkardell_]
ada: do you think we should move it into the WG?
12:45:43 [bkardell_]
bialpio: i have no problems with it if we meet the criteria
12:46:35 [bkardell_]
bialpio: it is pretty unique in that it is mainly a OS issue for mobile and pretty much with this flavor of the API that means some kind of chromium currently
12:47:24 [bkardell_]
ada: lets keep in the CG for now
12:48:05 [bkardell_]
ada: In the working group, we can look at some stuff and move it to CR, or things that are CR what can move to REC
12:48:09 [Leonard]
Leonard has joined #immersive-web
12:48:15 [Leonard]
present+
12:48:22 [bkardell_]
ada: Anchors is on oculus quest and androud - that would be good to move to CR
12:48:31 [bialpio]
q+
12:48:41 [bkardell_]
ada: Hit test is on both of those and wolvic, we could more them
12:49:01 [bkardell_]
ada: is it in wolvic
12:49:10 [bkardell_]
I don't know, is it jfernandez
12:49:18 [bkardell_]
jfernandez: no I dont think so
12:50:22 [bkardell_]
ada: webxr - there is still some little bit of work, could be the first spec fully finished by this wg...
12:51:15 [bkardell_]
ada: the webxr AR module and gamepad module seem like they are very stable, maybe we can move those to rec
12:51:35 [bkardell_]
ada: it would be good to move web xr hand input
12:51:46 [atsushi]
i/ada: Real World Meshing and Real World/topic: Administrivia: Review big wins since last TPAC, Accessibility task force, and moving standards forward [WebXR 1333]/
12:51:51 [ada]
ack bialpio
12:52:22 [bkardell_]
bialpio: We did have a couple of additions to specs that I know, for example, chrome doesn't implement. Persistence I think, hit testing with semantic labels
12:52:32 [bkardell_]
cabanier: it's optional
12:53:02 [bkardell_]
bialpio: There might be some parts of the spec that have been stable for a while but they aren't in all of the browsers yet - do we split it into modules or what?
12:53:48 [cabanier]
q+
12:53:53 [bkardell_]
ada: Our next charter isn't until next year - I don't mind if we add it to that or... 1) split it into levels 2) try to get the implementations to all them by july or 3) put it on as more in our charter
12:54:03 [bkardell_]
bialpio: as long as it is not a blocker
12:54:25 [yonet]
ack cabanier
12:54:27 [bkardell_]
ada: It will go out to more people to ask for objections and so on... This group just needs to think it is ready for that
12:54:29 [ada]
ack cabanier
12:54:41 [bkardell_]
cabanier: at some point we talked about becomming living specs?
12:54:52 [bkardell_]
ada: does someone know the process for that?
12:54:56 [dontcallmeDOM_]
[slide 16]
12:55:17 [dontcallmeDOM_]
Dan: our current charter ends at the end of October, we're in the process of rechartering - please comment on the proposed draft charter
12:55:27 [ada]
dontcallmeDOM_: y ou are i nthe wrong channel!!
12:55:30 [bkardell_]
dontcallmeDOM_: I think you are in the wrong channel
12:55:31 [bkardell_]
:)
12:56:00 [bkardell_]
ada: I will take an action item to look into how we do that
12:56:07 [bkardell_]
yonet: I will look into that
12:56:22 [bkardell_]
ada: it's probably not applicable to all of the specs, but certainly some of them.
12:57:29 [bkardell_]
ada: charles had an a11y task force issue - I thought it would be good to have a repo with all of them.. Right now we just have a label. It might get more good people involved if it wasn't just a thing that happens with labels in the background
12:57:44 [bkardell_]
cabanier: Did you mention the depth sensing module?
12:57:58 [bkardell_]
ada: it's in the WG already, but it is chrome only still so not a great one to move to CR
12:58:46 [bkardell_]
ada: Anyone can agenda any items they want
12:59:02 [bkardell_]
ada: 45 minutes on the <model> tag.. I think we have an issue
12:59:11 [yonet]
agenda: https://github.com/immersive-web/model-element/issues/69
12:59:34 [yonet]
topic: https://github.com/immersive-web/model-element/issues/69
12:59:40 [atsushi]
s|agenda: https://github.com/immersive-web/model-element/issues/69||
12:59:48 [bkardell_]
ada: introductions by dino
13:00:18 [Leonard]
Can the speaker be closer to a mic?
13:00:55 [Leonard]
TY, much better
13:01:09 [Leonard]
Now no audio
13:01:29 [alcooper]
Room cameras appear to have frozen as well
13:01:40 [Leonard]
Yes
13:02:24 [bkardell_]
dino: (presents slides)... I'm dean, there's a few other folks...
13:03:12 [bkardell_]
dino: we announced this product recently, but we've been working on it for years... WebXR is supported at launch, it's not quite ready... Our model for controler is "you don't have any"... so we have some things
13:04:11 [bkardell_]
dino: we don't want WebXR to be the only way you work with the Web. It needs to follow the normal web principles: safe and default, interoperable, privacy
13:04:24 [bkardell_]
dino: we want to say "it's not a different web" - it lets us extend the existing features, and add some new features
13:04:40 [bkardell_]
dino: it's really important to get high quality, realistic rendering...
13:05:02 [bkardell_]
dino: that's why we suggested some things need to be more in control of the OS or the browser itself
13:05:27 [bkardell_]
dino: we think you shouldn't have to be a coder or a 3d artist - that they should be able to make minor enhancements on existing pages
13:06:05 [bkardell_]
dino: specifically, gaze and eye tracking - we cannot provide every web page this information. That would be horrible
13:07:49 [bkardell_]
dino: (shows some videos of Vision OS) This is a flat page on vision SOS, and you can see as we move around it is just like a floating window in space you can walk around it... we can show that the illusion of 3d on the page is broken, and lots of things just want a model - you could do this with a webgl canvas, but that requires environment lighting and head tracking, etc
13:08:53 [bkardell_]
dino: you can see the <model> element - and it looks correctly 3d and you can see if we walk around it is kind of an illusion and you're looking into a portal... This is why we gave some feedback about why we didn't _just_ want to do webgl
13:10:01 [bkardell_]
dino: there are just lots of limitations too -- retained mode vs intermediate... retained mode has been tried a few times before, and all of them have failed--- so why should it work now. We think there are just a lot more apis out there that all sort of share a common subset at what they agree upon as a sort of model
13:11:14 [bkardell_]
dino: the next thing though is consistent interoperable rendering... real time 3d rendererers are just different than many other things. But recently in the last few years the industry beyond w3c has been working on this and we think it makes it possible
13:11:37 [Leonard]
https://materialx.org/
13:11:40 [bkardell_]
dino: material x is something from ILM that is declarative
13:12:19 [bkardell_]
dino: it describes the gltf rendering model - you see you have a fresnel effect - it's a very very powerful shading system built to be used in feature films as well as real time rendering
13:12:42 [bkardell_]
dino: it's also sort of procedural - you can see introducing some noise...
13:12:55 [dontcallmeDOM_]
[slide 4]
13:13:26 [dontcallmeDOM_]
dontcallmeDOM_ has left #immersive-web
13:13:38 [vicki]
vicki has joined #immersive-web
13:13:39 [bkardell_]
dino: next: What about file formats. Strangely when we first made this proposal this is what everyone seemed to care about - I suggested we should recommend them how the HTML spec does.
13:14:12 [bkardell_]
dino: apple and a few others in the company recently started a standards body around USD...
13:14:19 [Leonard]
Alliance for Open USD: https://aousd.org/
13:14:43 [ada]
q?
13:14:53 [Leonard]
I do, but will save them for later
13:15:33 [cabanier]
q+
13:16:03 [bkardell_]
bradley: You say we can't give you head tracking or eye tracking - could we put noise into the signal?
13:16:14 [bkardell_]
dino: we tried this, the answer is "no".
13:16:56 [bkardell_]
dino: you need both to be very accurate and we run into vestibular issues. Things that are 'slightly off' are strangely way worse than things that are way off
13:17:09 [yonet]
ack cabanier
13:17:26 [bkardell_]
cabanier: you showed material x -- are you proposing that as part of the model standard or...
13:18:10 [bkardell_]
dino: to be clear, I am just trying to show there are other standards bodies working on real time physically based models -- this is something we could adopt or build on.
13:18:12 [ada]
q?
13:18:19 [cwilso]
q+
13:18:30 [ada]
ack cwilso
13:18:52 [bkardell_]
cwilso: I have to disagree that the format doesn't matter. You would never try to build a browser today and not support jpeg
13:19:13 [Brandel]
q+
13:19:21 [cabanier]
q+
13:19:40 [bkardell_]
cwilso: and that is a really simplistic case. I'm not sure that this is going to happen. If we are aiming for interoperability great - but I'm not sure that happens in a world where we don't support the same formats or there isn't at least a common format
13:20:12 [bkardell_]
dino: It definitely does matter, the html spec doesn't _say_ that it requires jpeg, but things work themselves out
13:20:24 [bkardell_]
cwilso: because of licensing issues at the time
13:20:34 [bkardell_]
dino: there have been others since, png, for example
13:20:52 [bkardell_]
dino: there are divides in which browsers support which formats
13:20:57 [bkardell_]
cwilso: I don't like that
13:21:02 [bkardell_]
myles___: I don't understand
13:21:26 [yonet]
ack Brandel
13:21:27 [ada]
ack Brandel
13:21:41 [bkardell_]
cwilso: if we wind up in a world where apple supports X and google supports Y, but neither supports something common, I think we have failed
13:22:18 [ada]
q?
13:22:22 [ada]
ack cabanier
13:22:24 [bkardell_]
Brandel: It is really just about whether it is the space of the specification to say that -- not that it is not something to discuss. It's about whether it should go into the spec at this time
13:23:18 [bkardell_]
cabanier: the reason we all objected to USD was because there was no standard for it, but it sounds like this is being worked on and it can be developed in such a way as to run nicely in web browsers... If it can do all of these things, I don't see why we cannot support that
13:23:30 [bkardell_]
cabanier: maybe gltf comes later?
13:23:47 [IW]
IW has joined #immersive-web
13:23:53 [bialpio]
q+
13:23:58 [IW]
IW has left #immersive-web
13:23:59 [bkardell_]
dino: I think you should consider usd a superset of gltf
13:24:16 [bradleyn]
bradleyn has joined #immersive-web
13:24:49 [ada]
ack bialpio
13:24:50 [bkardell_]
cabanier: personally I don't care that there are so many, it's a bit of a pain. IT might be a problem later, but we can also tackle them later... If we wanted to break it open... we can do it later. Maybe by then the format will be better flected out
13:26:13 [Leonard]
q+
13:26:22 [bkardell_]
bialpio: maybe a question related to open usd... dino you mentioned that it was a "subset of usd" does that mean that the work that the alliance will be doing is specing and starting from scratch or... how would other implementers interact with that process -- is meta or google a part of that standards body? How will we be able to provide feedback? As a person who hasn't been in standardization so long, I'm not sure. I guess I will
13:26:24 [bkardell_]
have to impleement both
13:26:32 [cwilso]
q+
13:28:05 [bkardell_]
dino7: the alliance just started it has only a few members. I believe that once the charter is in place it would be expanded. I'm not sure. The goal of the alliance is to make a more clear specification for what USD is. It is effectively explaining all of the things a web specification would. USD did not describe them - so doing that makes it more intereoperable. Does it make sense?
13:28:09 [vicki]
vicki has joined #immersive-web
13:28:11 [ada]
ack Leonard
13:29:28 [bkardell_]
Leonard: Alliance for Open usd just started so I expect it will take several years to get to a spec. From what I understand it is not starting from scratch but taking existing work which is done mainly by example. There is active work between kronos and ? ... It's not anticipated that gltf will be able to make a lossless loop
13:30:46 [bkardell_]
s/kronos/AOUSD
13:31:23 [bkardell_]
Leonard: there are features in each format that aaren't present in the others
13:31:34 [ada]
q?
13:31:38 [ada]
ack cwilso
13:32:15 [Leonard]
Items of present: AOUSD is just starting. It will take at least a couple of years to get a written specification
13:32:52 [bkardell_]
cwilso: I want to be transparent about why this is important. I worked as MS when we did <object> -- we convinced people this would be interoperable. It never was. Pragmatically we never got that to work. Object has a great fallback mechanism, but basically no one ever used it because it was so powerful and what do you fall back to
13:33:09 [Leonard]
... Active work between USD (AOUSD) and Khronos (glTF) [mostly in Metaverse Standards Forum] to handle the interchange and differences
13:33:13 [bkardell_]
cwilso: where you need to fit this in is in HTML, so the bar there is in WHATWG
13:33:16 [ada]
ack dino
13:33:31 [bkardell_]
dino7: So what do you think we should do? What is the alternative?
13:34:11 [Leonard]
... It does not seem possible to make a lossless loop between USD and glTF. There are features of one that are not present in the other.
13:34:11 [dino]
dino has joined #immersive-web
13:34:27 [bkardell_]
cwilso: start with a format that has wider adoption or stay on the track that you're on and focus on getting wider adoption. I'm not trying to paint this the wrong way -- but is there even another parser strcuture for USD that has been implemented more than once? How much is specified? How much are you going to chop off for 'web usd'
13:34:33 [Leonard]
... glTF is actively working with OpenPBR (https://www.aswf.io/blog/academy-software-foundation-announces-openpbr-a-new-subproject-of-materialx/)
13:34:57 [Leonard]
... to use/incorporate their standard.
13:35:10 [bkardell_]
cwilso: You're not going to use the same renderers for a web page and a cinema movie, are you? This is tough because there are lots of capabilities of products...
13:35:28 [Leonard]
... OpenPBR is a sub-project of MaterialX and Academy Software Foundation (ASWF).
13:35:38 [bkardell_]
dino: I'm glad you said that - because it sounds like you're main concern is about interop..
13:35:51 [bkardell_]
cwilso: Yeah, it's been a long and painful process for videos
13:36:06 [Leonard]
q+
13:36:11 [ada]
q+
13:36:38 [bkardell_]
dino: I should have had a slide that it's going to be hard and there are going to take a while. Part of the reason I used material x is that it is one of the first ones where people are starting to agree like this...
13:37:13 [yonet]
q?
13:37:14 [alcooper]
q+
13:37:23 [ada]
ack Leonard
13:37:30 [bkardell_]
dino: If I sent a 16k video to a feature phone it's not going to work - it just happens to be that with 3d we hit that more quickly
13:38:35 [bkardell_]
Leonard: I had a question on the video you showed of the flat screen but the model had 3d characteristics... for at least the near future actually flat screens will be the predominant mode of consuming web pages -- does this benefit them? or
13:39:49 [ada]
ack ada
13:39:53 [bkardell_]
dino: that is what we were trying to do - it has to be visible on a flat screen because that is almost all screens at least currently. It needs to be designed for the whole range, just like anything for the web should be. You might not get the same beautiul rendering... the same way you do with steroscopic images maybe
13:40:13 [bkardell_]
ada: your comment about the hard work being done in the interop stage - would that be here or aousd?
13:41:11 [bkardell_]
dino: I think cwilso's comments about some of this belonging in HTML apply too. I guess that's the question I have for everyone, where should it happen. This seems like the most appropriate place in terms of interest
13:41:22 [ada]
q?
13:41:25 [ada]
ack alcooper
13:41:27 [bkardell_]
ada: implementers type of interested people are probably in this room yeah
13:41:57 [cabanier]
q+
13:42:13 [Leonard]
Note: Credits were missing from the 'Damanged Helmet' model. Details listed below.
13:42:19 [Leonard]
Taken from https://github.com/KhronosGroup/glTF-Sample-Assets/blob/main/Models/DamagedHelmet/README.md
13:42:28 [ada]
q?
13:42:28 [bkardell_]
Brandel: I think there are things common to both gltf and usd that would be criticisms of both.
13:42:28 [ada]
ack cabanier
13:42:32 [Leonard]
License & credits:
13:42:32 [Leonard]
© 2018, ctxwing. CC BY 4.0 International - ctxwing for Rebuild and conversion to glTF © 2016, theblueturtle_. CC BY-NC 4.0 International - theblueturtle_ for Earlier version of model
13:42:58 [ada]
q+
13:43:04 [Brandel]
s/Brandel/alcooper
13:43:08 [Leonard]
q+
13:43:12 [dino]
dino has joined #immersive-web
13:43:26 [ada]
ack ada
13:43:37 [bkardell_]
cabanier: I am concerned about the complexity - the place to worry about that though is probably in the formats. We tried to be clear about about how complex it could be
13:44:10 [ada]
q?
13:44:21 [bkardell_]
ada: do you think the formats themselves should include information about how to handle the lower level of detail use cases?
13:44:44 [ada]
ack Leonard
13:45:26 [bkardell_]
Leonard: Is this similar to the idea we talked about several years ago when we talked about create a favicon with lower level of detail
13:46:30 [bkardell_]
cabanier: It wasn't a standard, but it was kind of similar
14:04:12 [ada]
break over, we are starting again
14:04:40 [etienne]
etienne has joined #immersive-web
14:04:58 [ada]
zakim, choose a vitim
14:04:58 [Zakim]
I don't understand 'choose a vitim', ada
14:05:26 [ada]
present+
14:05:41 [myles___]
ada: We can crack on with other topics from the discussion.
14:05:56 [vicki]
vicki has joined #immersive-web
14:06:30 [myles___]
alex cooper: I was reading over your topics, and proposed topics, and can we discuss why we're building this stuff? It might help inform discussions later
14:06:30 [myles___]
ada: I'm open to doing that
14:06:30 [alcooper]
s/alex cooper/alcooper
14:06:35 [myles___]
cabanier: Is this about specific topics?
14:06:39 [myles___]
ada: who raised this issue?
14:07:20 [Maud]
Maud has joined #immersive-web
14:07:41 [myles___]
<general meta-discussion>
14:08:00 [atsushi]
rrsagent, publish minutes
14:08:02 [RRSAgent]
I have made the request to generate https://www.w3.org/2023/09/11-immersive-web-minutes.html atsushi
14:08:08 [ada]
https://github.com/immersive-web/model-element/issues/70
14:08:14 [yonet]
yonet has joined #immersive-web
14:08:24 [Brandel]
Brandel has joined #immersive-web
14:08:26 [atsushi]
s/https:/topic: https:/
14:08:32 [Brandel]
present+
14:08:39 [myles___]
Leonard: There are a lot of discussions about <model> since it was proposed 2 years ago. People have said about why it needs be done. I have never seen written descriptions about what we're trying to do that differs from existing things.
14:09:20 [cabanier]
q+
14:09:43 [myles___]
Leonard: In the video, that was the best I've seen about why <model> rather than model viewer. Also, privacy detections. It would be good to see this written down in the issues. I've spent a long time interacting with the issues. Why I wrote this issue is to understand why this is being proposed and its history, why existing systems are not being used, and why other systems are not sufficient
14:09:46 [atsushi]
i/ada: We can crack on/scribe+ myles___
14:10:05 [myles___]
Leonard: Let's get these things discussed instead of complaining about particular cases
14:10:16 [atsushi]
rrsagent, publish minutes
14:10:17 [RRSAgent]
I have made the request to generate https://www.w3.org/2023/09/11-immersive-web-minutes.html atsushi
14:10:24 [myles___]
ada: Should we discuss this now? Or is this ongoing work?
14:10:47 [dino]
q+
14:11:05 [myles___]
Leonard: Without thought, it would be difficult to produce what I'm looking for during the next hour. This is important to do for further discussion.
14:11:17 [myles___]
Leonard: If a number of peopl can go out and address this and provide specifics as to why something is or should not work. So the rest of us can address use cases
14:11:29 [ada]
ack dino
14:11:46 [myles___]
dino: I think Apple can take this action. Now that we can publicly talk about the justification. We'll handle it.
14:11:59 [myles___]
dino: I'm not joking. We will do it.
14:12:01 [alcooper]
q+
14:12:05 [ada]
ack cabanier
14:12:07 [myles___]
Leonard: That's great, thank you
14:12:20 [cwilso]
q+
14:12:26 [myles___]
cabanier: Dean's presentation covered a lot of what Leonard is asking for. Updating hte explainer to include the info will be good
14:12:33 [myles___]
ada: Can you share the presentation?
14:12:38 [myles___]
dino: I can share a modified version of it
14:12:49 [ada]
ack alcooper
14:13:11 [myles___]
dino: Keynote files are OK, right? Wait, nevermind, let's not argue about formats
14:13:11 [myles___]
alcooper: I'd like to see alternatives considered flushed out more.
14:13:11 [myles___]
dino: Sure thing.
14:13:11 [ada]
ack cwilso
14:14:24 [myles___]
cwilso: Off the cuff, Leonard, the original explainer for <model> probably explains that question better than anything else that's pointed to. It does talk about that a little bit. To be clear, I don't see model-viewer as a competitor to <model>. <model> is trying to satisfy use cases that are more integral to the language. model-viewer is "can we drop a model into a page and make it interoperable in many different implementations, at
14:14:24 [myles___]
around ~2015". There are some lessons we collected from that.
14:15:11 [ada]
q?
14:15:11 [myles___]
dino: I agree, and I felt bad using model-viewer page to show that. I only did that because there were so many people saying "we shouldn't do <model> and do model-viewer instead" but we can learn from model-element. <model> doesn't replace model-viewer.
14:15:18 [alcooper]
q+
14:15:39 [myles___]
dino: The explainer did go into that. There's a random thread by weinig on Twitter (X?) that explained the rationale behind <model>. He was getting a lot of feedback.
14:15:48 [myles___]
ada: Please preserve that. Twitter might not be around forever
14:15:51 [ada]
q?
14:15:53 [myles___]
dino: I'll try to figure it out
14:15:53 [ada]
ack alcooper
14:16:37 [myles___]
alcooper: Something that was mentioned is that he's had a hard time trying to keep that API surface down. One concern for <model> is to not have every browser re-implement a game engine. It's something to keep in miind.
14:16:47 [ada]
q?
14:16:55 [ntim]
https://twitter.com/samweinig/status/1445464463067398154
14:16:58 [Leonard]
Thanks for addressing it
14:17:02 [dino]
^^ that was Sam's twitter thread
14:17:05 [myles___]
s/miind/mind/
14:17:25 [dino]
but we'll make an update to the explainer to include more justification
14:17:27 [myles___]
Topic: Specifying an image-based light
14:18:30 [gombos]
gombos has joined #immersive-web
14:18:34 [myles___]
Brandel: In our exploration and experimentation with <model> it's become clear that even on environments where they've provided <missed> the model as it currently exists is within the context of the page. There's a strong indication that the lighting is the lighting from the page rather than the world. It's important to be able to control lighting. Marketing organizations in particular want to control this.
14:19:09 [vicki]
vicki has joined #immersive-web
14:19:13 [myles___]
Brandel: In that context it would be important for us to be able to specify an environment map or image-based light. It seems pretty important that that format be an HDR format. To my knowledge, nobody has HDR at this point. There was a breakout session about HDR. I just wanted to raise it in here at this time.
14:19:18 [ada]
q?
14:19:31 [Leonard]
q+
14:19:52 [ada]
ack Leonard
14:20:08 [myles___]
Leonard: I agree with that. Is this the right working group? Or is that something that should soley done with a 3D context?
14:21:22 [bajones]
bajones has joined #Immersive-Web
14:21:49 [yonet_]
yonet_ has joined #immersive-web
14:21:53 [ada]
q?
14:22:11 [bajones]
q+
14:22:24 [Leonard]
Agree with need for HDR. Where is the best forum to handle it. Here if it is 3D only; other WG for general browser support
14:22:31 [myles___]
Brandel: I don't want to exclude raising it elsewhere. Are there discussions that we need to have? I thought we could pre-populate that with views about the case for it, and some of the attributes/properties of an HDR format might not be familiar with folks
14:22:36 [ada]
q?
14:22:39 [ada]
ack bajones
14:22:40 [cabanier]
q+
14:22:52 [yonet_]
ack brandon
14:23:05 [myles___]
bajones: hi
14:23:11 [yonet_]
ack bajones
14:23:19 [Leonard]
... If it is general browser, then need to make sure it is not just 8-bit colors. There is precendence for 3D-only: KTX
14:23:52 [Leonard]
... does not display in a browser. It requires a GPU to decompress and display, so it is used on 3D models, and not web pages
14:24:11 [myles___]
bajones: HDR is something that has had a lot of ongoing discussions in WebGPU, and video and 2d canvas and CSS and such. I've sat through many of their presentations and I understand a little better now, but not enough to explain it to a group like this. But it does sound like there is at least some headway being made there in terms of having different image sources being able to output to the browser that can be displayed on a variety
14:24:11 [myles___]
of displays and has all the attributes that people are looking for.
14:25:40 [ntim]
ntim has joined #immersive-web
14:25:40 [myles___]
bajones: Please don't try to re-invent any wheels here. It's a dense topic. I think we will generally be able to rely on straight webxr point of view - we can rely on the output of these groups to feed into any comparative content that we create. For <model>, I think that you should generally be able to just provide some of these attributes that would otherwise go to a video or other images, and provide it as part of a model or part of
14:25:40 [myles___]
the embedding tag, and piggyback on what they're doing there. I wish I was in a better position to have more details on what format that is
14:25:40 [myles___]
bajones: I think we should lean into what they're doing and provide a consistent surface for HDR across the web.
14:25:40 [ada]
q?
14:25:40 [myles___]
Brandel: Cool
14:25:40 [Leonard]
+1 to Brandon's comment
14:26:23 [myles___]
Brandel: One difference about our use of HDR is we have no expectation of displaying the whole gamut range of the file. We use it for an estimation. We need to think about that code wildly different intensities than anyone else. Because it's a precursor step to the ultimate display. But it's great to have that conversaiont.
14:27:41 [myles___]
bajones: Are you talking about the materials, or lighting?
14:27:41 [myles___]
Brandel: Lighting.
14:27:41 [myles___]
bajones: The materials would make the <missed> as well.
14:27:41 [myles___]
bajones: My understanding is many times when you're dealing with HDR content, the materials don't actually contain much HDR information. There's not a whole lot of value going into a particular material and saying "this is 300% red." But oftentimes, the HDRness is just being able to capture the full range of illumination that's being applied to those materials.
14:27:41 [myles___]
Brandel: <nods>
14:27:46 [ada]
ack /url 1
14:28:03 [myles___]
bajones: I don't think we need special HDR materials. You can still embed 10/10/10/2 or something like that. But HDR isn't necessary for materials.
14:28:04 [ada]
q?
14:28:07 [ada]
ack cabanier
14:28:08 [yonet_]
ack cabanier
14:28:19 [myles___]
cabanier: Why does the browser need to specify this global lighting image? Can it not be part of the USD file itself?
14:28:35 [dino]
q+
14:28:36 [myles___]
cabanier: If we're going to do this, HDR becomes a problem. Now we have to define how it is on a browser that supports HDR and one that doens't.
14:28:55 [yonet_]
ack dino
14:29:05 [myles___]
cabanier: I think this might spiral out of control and make implementation, how to define it, much harder.
14:29:05 [myles___]
cabanier: Can it just be part of the format?
14:29:25 [myles___]
dino: Are you talking about IDLs? You could definitely embed image-based lighting into a file format. It is possible definitely in USD. You might want different IDLs for the same model in different circumstances.
14:29:29 [myles___]
cabanier: Could you post different models?
14:29:35 [myles___]
dino: Yes, but they would be different files.
14:29:41 [myles___]
dino: You'll want it external to the file.
14:30:31 [myles___]
dino: You want to say "how does this green look when in a restaurant showing off to my friends, vs when i'm outdoors, vs when i'm in my living room"
14:30:31 [Leonard]
q+
14:30:31 [myles___]
cabanier: It's too much effort to have different models for different conditions?
14:30:31 [bajones]
q+
14:30:33 [myles___]
ada: if it's a big file, it's duplicated.
14:30:38 [myles___]
dino: Sometimes you _do_ want to embed it in the file.
14:30:58 [yonet_]
s/idl/image-based-lighting
14:31:05 [myles___]
cabanier: Is this such a big use case that it's worth accounting for?
14:31:22 [bajones]
q- (Dean is making my point right now)
14:31:55 [myles___]
cabanier: Is this such a big use case that it's worth accounting for?
14:31:55 [myles___]
dino: The case is: The 3d models we show on apple.com, they have lighting that's specifically picked by the designers, specifically for product showcase. If you took that same model, and viewed it in AR, you want the realistic lighting of the environment.
14:31:55 [myles___]
dino: You want to use the same file in different places
14:31:55 [myles___]
cabanier: You want it to look OK in a place where there is no lighting?
14:32:41 [bradleyn]
bradleyn has joined #immersive-web
14:33:05 [myles___]
Brandel: Even if we were to package an IDL on a particular model, it would make sense in AR quicklook use in a phone, to use the estimated lighting that comes from the system. In a webpage, it's in portol. It's not immediately clear that it exists in the world. The presentation context has more opinion about what kind of lighting and color it should take on
14:33:10 [myles___]
Brandel: there are 2 different things that can be done with the model, but people can probably use a custom image based lighting for an environment map in an AR view, it doesn't necessarily make sense to carry it along.
14:33:39 [myles___]
Brandel: For HDR, it's important to have an HDR image based light, simply because the sun is very bright. The illumination component that comes from the sun, it's way brighter than whatever device you're on.
14:33:40 [ada]
q?
14:33:48 [ada]
ack Leonard
14:35:05 [myles___]
Leonard: You might not get bright light halogen or LED, you only want to have a single model, because if changes to the model you have to propagate them out. In the glTF context, you don't embed lighting in the model file. The player can choose it as necessary. What you might want to use in a room vs when you take that same model and walk outside with it.
14:35:21 [myles___]
Leonard: If the browser can display an HDR image is separate. There is work in other working groups, even out of the W3C, to make it work. We shouldn't go there until they are done.
14:35:29 [ada]
ack bajones
14:36:01 [myles___]
bajones: I am here. I tried to take myself off the queue. You want different lighting on the page vs an immersive environment.
14:36:16 [myles___]
ada: break for coffee. Come back in 15 minutes
14:41:51 [caoxiaoran]
RRSAgent, make minutes
14:41:52 [RRSAgent]
I have made the request to generate https://www.w3.org/2023/09/11-immersive-web-minutes.html caoxiaoran
14:42:00 [myles]
myles has joined #immersive-web
14:47:02 [caoxiaoran]
caoxiaoran has left #immersive-web
14:55:05 [Maud]
Maud has joined #immersive-web
14:58:38 [yonet]
yonet has joined #immersive-web
14:58:47 [etienne]
etienne has joined #immersive-web
14:59:46 [Leonard]
Can you fix up the room cameras?
15:01:24 [myles]
myles has joined #immersive-web
15:01:55 [Leonard]
We have all gotten so good at zoom calls, we don't know how to deal with F2F!
15:02:46 [cabanier]
scribenick: cabanier
15:03:50 [cabanier]
topic: Camera controls, being able to move the pivot point rather than just tumbling around the world origin.
15:04:30 [cabanier]
Brandel: currently, the proposal has a camera control that consists of pitch/yaw/scale
15:04:44 [cabanier]
... this is because it's generally understood that people don't like roll
15:04:58 [atsushi]
atsushi has joined #immersive-web
15:05:09 [cabanier]
... but also having full 360 controls is not appropriate for stereo displays
15:05:19 [cabanier]
... but we should talk about other platforms
15:05:45 [cabanier]
... the intent of the webkit implementation might need further constraints
15:05:48 [bajones]
q+
15:05:54 [ada]
ack bajones
15:05:57 [cabanier]
... what is the bare mimimum for model
15:06:18 [cabanier]
bajones: the pitch/yaw/scale is for orbit camera ccontrols?
15:06:38 [cabanier]
... yes, that is appropriate
15:06:57 [cabanier]
... for targeting, we need to make sure that the element itself is able to predict the center
15:07:12 [cabanier]
... because very often there is a mismatch
15:07:21 [cabanier]
... and you never find it
15:07:32 [cabanier]
... the element needs to identify the center of the object
15:07:42 [cabanier]
... and the external bounds and center itself
15:07:48 [ntim]
ntim has joined #immersive-web
15:07:55 [cabanier]
... otherwise people will have bad time
15:08:09 [cabanier]
... it might be good to have an override
15:08:32 [cabanier]
... there's an obvious thing that people want but there's a niche thing that others want
15:08:45 [ada]
q?
15:08:50 [Leonard]
q+
15:08:51 [bialpio]
q+
15:08:53 [gombos]
gombos has joined #immersive-web
15:09:00 [ada]
ack Leonard
15:09:34 [Brandel]
q+
15:09:34 [cabanier]
Leonard: does this discussion limit the depth of field?
15:09:37 [bajones]
q+
15:09:43 [cabanier]
... like the focal distance
15:09:54 [ada]
ack Brandel
15:10:17 [cabanier]
Brandel: the goal is to define the point of interaction
15:10:39 [cabanier]
... there's no notion of depth of field
15:10:54 [cabanier]
... there's no dref or focal point support on our devices
15:11:01 [cabanier]
... that would be a separate aspect
15:11:11 [cabanier]
... (???)
15:11:13 [ada]
q?
15:11:20 [ada]
ack bialpio
15:11:21 [vicki]
vicki has joined #immersive-web
15:11:26 [ada]
q++ bialpio
15:11:31 [cabanier]
bajones: for depth of field, we don't want to apply it automatically
15:11:34 [ada]
q- +
15:11:48 [cabanier]
... it's something that the embedder will want to set automatically
15:11:59 [cabanier]
... we don't want to lock the ability
15:12:06 [cabanier]
... it would be a separate control
15:12:19 [cabanier]
... and it would be like setting a focal plane
15:12:45 [cabanier]
... this is an artistic choice so should be left to the person embedding or creating the model
15:13:02 [ada]
ack bialpio
15:13:04 [Leonard]
ATM glTF does not have a facility for depth of field
15:13:07 [cabanier]
... it's not something that this would interfere with. It's a separate control
15:13:23 [cabanier]
bialpio: how will we expose the camera control?
15:13:51 [Brandel]
q+
15:13:57 [cabanier]
... do we think it's a problem that the site has to account for both?
15:14:18 [cabanier]
... is it a hybrid model where we allow turning even if it's turned off?
15:14:34 [yonet]
ack bajones
15:14:35 [ada]
ack bajones
15:14:41 [ada]
ack Brandel
15:14:58 [cabanier]
Brandel: the current representation has controls inline on the page
15:15:13 [cabanier]
... so there's a capability to rotate the model
15:15:59 [bajones]
q+
15:16:03 [cabanier]
... (??) our users like to mess with the camera
15:16:23 [cabanier]
... it is possible to camera controls on all views
15:16:25 [cabanier]
... I
15:16:41 [cabanier]
... I'm interested how people deal with those transforms
15:16:41 [ada]
q?
15:16:44 [ada]
ack bajones
15:16:48 [Leonard]
q+
15:17:05 [ada]
q+ bajones
15:17:08 [ada]
ack Leonard
15:17:13 [bajones]
q+ I actually did want to say something this time!
15:17:19 [cabanier]
Leonard: are the camera controls on the camera or do they rotate the object?
15:17:35 [bajones]
q+ to actually say something this time!
15:17:57 [cabanier]
Brandel: it's a pith/yaw/scale on the object itself
15:18:09 [cabanier]
Leonard: so it's like walking away from it
15:18:27 [cabanier]
Brandel: yes, by user interacting or walking
15:18:34 [cabanier]
Leonard: (???)
15:18:39 [cabanier]
Brandel: yes, it's the same
15:18:44 [ada]
ack bajones
15:18:44 [Zakim]
bajones, you wanted to actually say something this time!
15:19:21 [cabanier]
bajones: it feels like the camera controls are needed. depth of field would be hard in stereoscopic
15:19:39 [cabanier]
... how do you determine how deep intro the page the object is?
15:19:50 [cabanier]
... because that might change the way you interact with it
15:20:10 [cabanier]
...is it a magic window or protruding from the page?
15:20:16 [cabanier]
... are there controls for that?
15:20:25 [ada]
q?
15:21:01 [cabanier]
Brandel: currently is inset into the page. It's reasonable to alter that but I don't have an answer for that
15:21:31 [cabanier]
... it might be reasonable to specify a pivot point
15:22:14 [cabanier]
bajones: I'm making an assumption that if the object protrudes the page, it will be clipped
15:22:30 [cabanier]
... it won't satisfy everyone
15:22:49 [cabanier]
... (???)
15:23:16 [ada]
q?
15:23:17 [cabanier]
... we need to work on way to not have things pushed out of the page
15:23:48 [cabanier]
topic: Extra Camera controls? 2D browsers might want to control FOV etc
15:23:51 [Leonard]
I disagree with Brandon, but not enough to bring it up verbally. I think you allow objects to be closer than near-clipping plane of the page...
15:24:56 [Leonard]
... If you have a wall-mounted sculpter, it is likely that you want the page to be wall-aligned with the scuplter coming out of the wall (aka page)
15:25:08 [cabanier]
Brandel: it's hard to see what the common denominator is
15:25:10 [ada]
q?
15:25:17 [bajones]
q+
15:25:21 [ada]
ack bajones
15:25:43 [Leonard]
s/sculpter/sculpture/g
15:25:44 [cabanier]
bajones: I think it's one of the areas to see what the mvp is
15:26:24 [cabanier]
... but I'm unsure if we need to dive into this for the first version
15:26:45 [cabanier]
... maybe we can start by saying what you see in 3D, is on the page but stereoscopic
15:26:56 [cabanier]
... then allow developer feedback to go from there
15:27:08 [cabanier]
... the potential for feature creep is large
15:27:25 [cabanier]
... my general leaning is to focus on the minimum that is still useful
15:27:53 [cabanier]
... we can add a lot of capabilities that nobody is going to use
15:28:13 [cabanier]
... it's a slow process but that's ok since that is how the web works
15:28:31 [cabanier]
topic: Can they have background images? BG color yes. Can the portal be transparent
15:29:05 [cabanier]
Brandel: it would be nice for the portal to have the same color
15:29:22 [cabanier]
... I'm unsure if the background image should be part of the spec
15:29:35 [cabanier]
... it's not as good to control with an image background
15:30:00 [Leonard]
q+
15:30:13 [cabanier]
... having a transparent background makes it hard because the depth
15:30:21 [bajones]
q+
15:30:21 [cabanier]
... if anyone has examples
15:30:27 [ada]
ack Leonard
15:30:45 [cabanier]
Leonard: does transparent mean that the background is the camera?
15:31:13 [cabanier]
Brandel: for this proposal, I envision that the (??)
15:31:26 [cabanier]
Leonard: so you'd see the page elements behind the canvas?
15:31:29 [cabanier]
Brandel: yes
15:31:33 [yonet]
ack bajones
15:32:15 [cabanier]
bajones: yes, like canvas can be transparent and float on top of a block of text
15:32:17 [cabanier]
q+
15:32:44 [cabanier]
... then either the text needs to be in stereo mode
15:33:00 [Leonard]
q+
15:33:13 [cabanier]
... my inclination is that if you have a transparent background, you don't get stereoscopic
15:33:30 [cabanier]
... so the default maybe should be to not be transparent
15:33:49 [cabanier]
... the other thing that I want to mention is image background
15:34:00 [cabanier]
... you could surround it with a sphere
15:34:08 [dino]
dino has joined #immersive-web
15:34:26 [cabanier]
... but that could be problematic if you move around
15:35:01 [cabanier]
... I think you can make the argument that there's a cubemap style image
15:35:07 [cabanier]
... not sure if it's part of the mvp
15:35:42 [cabanier]
... maybe an environment map style image
15:36:05 [yonet]
q?
15:36:06 [cabanier]
... I see that use case but not sure if it's needed right away
15:36:11 [yonet]
ack cabanier
15:36:19 [Leonard]
q-
15:36:24 [Leonard]
Agree with Brandon
15:36:38 [cabanier]
cabanier: would it make sense if the model punches out a hole in the page
15:36:43 [Leonard]
... on image (environment) background
15:36:53 [cabanier]
bajones: that would make a big change between 2d and 3d
15:37:08 [cabanier]
... I don't think developers would expect that
15:37:16 [ada]
q?
15:37:27 [cabanier]
... so we'd like to have an explicit option for that
15:37:29 [bradleyn]
q+
15:37:40 [ada]
ack bradleyn
15:38:11 [bajones]
q+
15:38:12 [cabanier]
bradleyn: what if you give it a stretch property so you can push it in?
15:38:17 [ada]
ack bajones
15:38:27 [cabanier]
bajones: that would be very tricky to specify
15:39:01 [cabanier]
... you can image that as you scroll there are 3d elements that scroll over text
15:39:44 [cabanier]
... but in most cases it can overlay text on the page
15:39:44 [Jesse_Jurman]
q+
15:39:44 [cabanier]
... given your description you would have a black hole effect
15:39:59 [cabanier]
... when you view this in immersive environment, you'd sink it into the space
15:40:34 [cabanier]
.... so the text would sink into the background
15:40:34 [Leonard]
Call the black-hole effect!
15:40:34 [cabanier]
... that would be really awkward
15:41:33 [cabanier]
... maybe there's a use for that type of effect but specifying transparent should not trigger this
15:41:52 [yonet]
ack Jesse_Jurman
15:42:04 [cabanier]
Jesse_Jurman: is this excluse to the model element?
15:42:17 [cabanier]
... or is this something that any element can opt into?
15:42:26 [cabanier]
... maybe you can do this in CSS
15:42:36 [Brandel]
q+
15:42:39 [cabanier]
... so text or an image could do this
15:43:03 [yonet]
ack Brandel
15:43:07 [cabanier]
Brandel: in this context, it's around the model on the page
15:43:33 [cabanier]
... we don't have a way for people to knock out pixels
15:43:49 [cabanier]
... this is in terms about what we do with the concept of transparency
15:44:19 [cabanier]
... what you propose is a general problem
15:44:35 [Leonard]
q+
15:44:42 [cabanier]
... the model element is the first stereoscopic element on the page
15:45:23 [yonet]
ack Leonard
15:46:02 [bajones]
q+
15:46:03 [cabanier]
Leonard: is this similar to CSS z-index
15:46:23 [yonet]
ack bajones
15:46:46 [cabanier]
bajones: this is similar to compositing in a stereoscopic effect
15:46:47 [cabanier]
q+
15:47:11 [cabanier]
... but that would not work at all because z-index expects to be drawn in 2d
15:47:24 [cabanier]
... if you use this as a queue for actual depth, this won't work
15:47:32 [cabanier]
... it would be great
15:47:43 [ntim]
2D HTML/CSS has the top layer
15:47:48 [cabanier]
... but you don't want to use existing cues of the page
15:48:36 [cabanier]
... maybe something that's at the top of the page to make you opt in
15:49:01 [cabanier]
... you want to have the developer say that they want this
15:49:28 [cabanier]
... we can expect that the vast number of developers to still develop in 2d
15:49:56 [yonet]
ack cabanier
15:51:44 [cabanier]
cabanier: a number of years ago, there was a proposal and an implementation from Magic Leap to have 3D transforms apply in actual 3D. I believe the webkit team said that they would implement this and would satisfy your request
15:52:53 [cabanier]
topic: Do we want to expect visible transport controls, or will it all be done in custom JS?
15:52:59 [ada]
present+
15:53:01 [cabanier]
present+
15:53:01 [atsushi]
rrsagent, publish minutes
15:53:02 [RRSAgent]
I have made the request to generate https://www.w3.org/2023/09/11-immersive-web-minutes.html atsushi
15:53:08 [yonet]
present+
15:53:15 [ada]
zakim, choose a victim
15:53:15 [Zakim]
Not knowing who is chairing or who scribed recently, I propose Leonard
15:53:34 [ada]
zakim, choose a victim
15:53:34 [Zakim]
Not knowing who is chairing or who scribed recently, I propose takashi_m
15:53:50 [ada]
zakim, choose a victim
15:53:50 [Zakim]
Not knowing who is chairing or who scribed recently, I propose yonet
15:54:15 [ada]
zakim, choose a victim
15:54:15 [Zakim]
Not knowing who is chairing or who scribed recently, I propose cabanier
15:54:51 [bialpio]
scribenick: bialpio
15:55:10 [atsushi]
meeting: Immersive Web WG/CG TPAC Day 1
15:56:08 [bialpio]
Brandel: models can have animations
15:56:52 [bialpio]
...: animations can have a duration specified so models can be understood as media elements
15:57:03 [Leonard]
q+
15:57:10 [bialpio]
...: how do we think the minimal treatment of animations should be presented in the MVP?
15:57:15 [yonet]
ack Leonard
15:57:35 [bialpio]
Leonard: not all models are intended to have their animations autoplayed
15:57:48 [bialpio]
...: they can be played in response to events, they can have multiple tracks
15:58:04 [bialpio]
...: we should not spec that they should autoplay their first tracks
15:58:17 [ada]
q?
15:58:18 [bialpio]
Brandel: ???
15:58:19 [bajones]
q+
15:58:27 [yonet]
ack bajones
15:58:50 [bialpio]
bajones: there is common use case for video where you have an embedded player
15:59:03 [bialpio]
...: secondary uses are video that is being used as visual element in the page
15:59:18 [Brandel]
(I just said that a lot of people use <video> in a way where it is desirable to hide it)
15:59:23 [bialpio]
...: default behavior is you get the controls for video and then they can be hidden
15:59:37 [bialpio]
...: for model it should probably be the opposite
16:00:00 [ada]
q+ CSS
16:00:06 [ada]
q- CSS
16:00:18 [ada]
q+ I would like the ask about CSS animation
16:00:28 [bialpio]
...: but there may be cases where it's desired to step through animations
16:00:32 [ada]
q+ to ask about CSS animation
16:00:57 [Leonard]
A few cases where it can be nice to have controls: product assembly (IKEA products), simulations
16:01:07 [bialpio]
...: those controls can be built by the page, for video most users build their own controls
16:01:25 [cabanier]
q+
16:01:27 [nhk-ryo]
nhk-ryo has joined #immersive-web
16:01:36 [bialpio]
...: if you want to use model element in the context of sth like sketchfab, they'll probably build their own controls
16:01:39 [ada]
ack ada
16:01:39 [Zakim]
ada, you wanted to ask about CSS animation
16:01:50 [bialpio]
...: there should be programmatic control but we may not need to build the controls in
16:02:21 [bialpio]
ada: it'd be nice to have scroll-based timelines
16:02:51 [bialpio]
...: so then a model would play the animation when the user scrolls down the page
16:03:00 [bialpio]
...: unsure about the best way to achieve this
16:03:13 [yonet]
ack cabanier
16:03:27 [bialpio]
cabanier: it may not be needed for MVP to build in the controls
16:03:43 [bialpio]
...: may be problematic to specify the position of the controls
16:03:45 [alcooper]
q+
16:03:56 [bialpio]
...: maybe just specify "auto play default animation or no"
16:03:59 [yonet]
ack alcooper
16:04:11 [bialpio]
alcooper: agree that we should let pages build their own controls
16:04:30 [bajones]
q+
16:04:32 [bialpio]
...: but how can this be done? the point of model was that it's the browser that does things
16:04:42 [yonet]
ack bajones
16:04:46 [bialpio]
...: so now we need extra API surface for sites to build the UI
16:05:17 [bialpio]
bajones: we need to be careful how to do this
16:05:26 [cabanier]
q+
16:06:12 [bialpio]
...: in magic leap there was a car model config that got entirely disconnected from what was set on a page when it was torn out into the environment
16:06:39 [dino]
it might be enough to start with HTMLModelElement having part of the HTMLMediaElement API. Don't worry about multiple animations. Just a simple currentTime and paused, etc.
16:06:50 [RRSAgent]
I have made the request to generate https://www.w3.org/2023/09/11-immersive-web-minutes.html atsushi
16:06:59 [bialpio]
...: we probably want the model to be connected to the page
16:07:14 [bialpio]
...: so whatever controls are left in the page can still control the model
16:07:18 [dino]
The good news is that HTMLMediaElement has done all the hard work on API design.
16:07:33 [bialpio]
...: some of this is OS-level
16:07:52 [etienne]
etienne has joined #immersive-web
16:07:59 [bialpio]
Brandel: currently in model we have a model on a page that stays on a page and lives in a page
16:08:15 [bialpio]
...: you can extract quicklook models out of a page
16:08:21 [yonet]
ack cabanier
16:08:28 [bialpio]
...: transport controls are in context of a page when viewed on a page
16:08:33 [bajones]
Thanks for the clarification!
16:08:48 [bialpio]
cabanier: what dino showed is a 2d surface with stereo rendering
16:08:56 [vicki]
despite the fact that most sites implement their own video controls, I think it would be strange to provide an API to control model playback without providing built-in controls.
16:09:07 [dino]
bajones, did you see the videos I showed earlier?
16:09:14 [bialpio]
...: magic leap would hand off the model to system compositor and the sys. compositor would show it above the page
16:09:35 [bialpio]
...: the model is handed off to another process that renders it in a different context
16:10:02 [bialpio]
dino: we get requests for being able to take the object out of the page and have it still controlled by JS
16:10:39 [bialpio]
cabanier: in case of magic leap they had option for room-scale, the model would be in the room and the browser would still be visible
16:10:47 [bialpio]
...: this was gated by permission prompt
16:10:57 [bialpio]
...: it required user intent
16:11:21 [bialpio]
dino: similar to full-screen that could spoof UI that user trusts
16:11:46 [bialpio]
...: we thought about this and didn't come up with acceptable solution
16:11:57 [xiaoqian]
xiaoqian has joined #immersive-web
16:12:10 [bialpio]
...: model's in a page when it is in a page, but when it's pulled out it will be taken over by sth else
16:12:12 [ada]
q?
16:12:23 [bialpio]
...: if a browser can do it safely then fine
16:12:38 [bialpio]
cabanier: would you allow it or would it be forbidden?
16:12:44 [bajones]
q+
16:13:19 [bialpio]
dino: IDK, maybe we could do model.fullscreen ?
16:13:37 [bialpio]
...: not a suggestion, just sth we were thinking about
16:13:49 [bialpio]
...: people will want to take things out into their space
16:14:01 [bialpio]
...: web devs will also want that to happen
16:14:24 [bialpio]
...: IDK if we need to formalize the API right away
16:14:28 [yonet]
ack bajones
16:14:45 [bialpio]
bajones: I like dino's suggestion to use fullscreen
16:15:00 [bialpio]
...: it does seem like model is breaking into 2 different use cases
16:15:30 [bialpio]
...: games? object placement? etc
16:15:58 [bialpio]
...: being able to take the model into fullscreen seems like a reasonable option
16:16:11 [bialpio]
...: the page would stay in the background and JS will run
16:16:29 [bialpio]
...: 2nd use case is someone taking the model out of a page as a widget
16:16:36 [bialpio]
...: that'd run in perpetuity w/o having to run the page
16:16:38 [ada]
q+ to mention service workers
16:16:51 [bialpio]
...: or maybe we could have some kind of a worklet that keeps running
16:17:34 [bialpio]
...: I will be sad if we didn't have a way of pulling the model out and still being able to programatically control it
16:17:48 [ada]
q-
16:17:51 [bialpio]
dino: very useful but we should not worry about it for MVP
16:17:55 [bialpio]
bajones: agreed
16:18:34 [bialpio]
dino: "I'm shopping for a couch, pull it out into my env, but I don't want to quit this mode" - that seems like the use case here
16:18:47 [bialpio]
...: but unsure how to do it safely and securely right not
16:18:50 [bialpio]
s/not/now
16:18:59 [bialpio]
...: but not essential yet
16:19:42 [bialpio]
Brandel: model can have a ground shadow - related to presentation mode in quicklook
16:19:58 [bialpio]
...: helps visually understand what's happening
16:20:18 [bialpio]
...: in stereoscopic context it may not make sense because we already have other visual cues
16:20:55 [bialpio]
...: curious if people think it's valuable - always on, always off, configurable?
16:21:03 [bajones]
q+
16:21:04 [Leonard]
Q=
16:21:07 [Leonard]
q+
16:21:08 [ada]
ack bajones
16:21:33 [bialpio]
bajones: it won't be appropriate for every model in every context for it to be always on
16:21:39 [bialpio]
...: solar system?
16:22:43 [bialpio]
...: you may not want to have an implied ground
16:22:43 [bialpio]
...: there's a lot of models that put a platform in the model itself that acts as a ground
16:22:43 [ada]
q+ to ask about ShadowMaterials in model formats
16:22:45 [bialpio]
...: not too many scenarios where ground shadow is really important in the page itself
16:22:56 [bialpio]
...: if you have the model exist outside of page then sure
16:23:11 [ada]
ack Leonard
16:23:14 [bialpio]
...: in a page the lack of a shadow may not be too problematic
16:23:29 [bialpio]
Leonard: when you don't have a shadow, will it be bad for UX?
16:24:08 [bialpio]
...: if a shadow is done badly, how bad is it?
16:24:08 [bialpio]
...: if the model is bounded, will the shadow be clipped and how will that affect UX?
16:24:17 [ada]
ack ada
16:24:17 [Zakim]
ada, you wanted to ask about ShadowMaterials in model formats
16:24:29 [bialpio]
...: may be easier for MVP to skip the shadows and add capabilities for sites to add them
16:24:35 [bialpio]
ada: some engines have shadow materials
16:24:49 [bialpio]
...: which are only going to get colors from shadows
16:25:06 [bialpio]
...: they will be transparent if there is no shadows
16:25:43 [bialpio]
Brandel: not a real world entity, just something that receives shadows
16:26:00 [bialpio]
Leonard: content creator's choice, but you need to know the light source correctly
16:26:08 [bialpio]
ada: you can put light source inside the model
16:26:32 [bialpio]
...: or the page (?) can have a light source and since the browser renders things it can do so properly
16:26:43 [ada]
q?
16:26:45 [bialpio]
Leonard: will probably also fall under "not in MVP but maybe later"
16:27:46 [bialpio]
yonet: we can change the schedule (frequency of mtgs) so we can chat about model more frequently in our regular meetings
16:28:27 [bialpio]
ada: good discussion, see you tomorrow!
16:29:22 [bialpio]
...: zoom link in IRC for web apps WG meeting
16:29:33 [atsushi]
rrsagent, publish minutes
16:30:04 [RRSAgent]
I have made the request to generate https://www.w3.org/2023/09/11-immersive-web-minutes.html atsushi
16:36:17 [ryo]
ryo has joined #immersive-web
17:00:35 [xiaoqian]
xiaoqian has joined #immersive-web
18:39:15 [Zakim]
Zakim has left #immersive-web