π¬ Synthesis Superintelligence: from Semiconductors to Superconductors β Periodic Labsβ Liam Fedus and Ekin Dogus Cubuk
Itβs hard to believe that Periodic was only launched last September: One year later, it is considered one of the pre-eminent AI scientist labs, with dizzying talent density and astonishing progress in the autonomous lab buildout: Most people are famili...
8 Oct 2026 Β· 1:23:59 Β· transcript: transcribed Β· original
Claims
In the order they were said
βthink that's sort of the the thesis and premise behind periodic that dojo i thought when we were building this which is You can't just think your way to a solution. The universe is so complicated that in order to actually push the frontier of knowledge and to make progress, you need to create these conjectures and then actually see whether or not it holds.β
βNo amount of rereading that textbook or paper and just thinking and like disappearing into a room is going to allow you to think through all possible experimental outcomes expected and unexpected.β
βand you really need this like iterative process and that's our core belief for putting this together and that's why from the very beginning we're like we need to have the AI systems the simulations of the physical world but then also to build up the the physical high throughput experiment and we think a different type of intelligence emerges from thatβ
βYeah, I mean a team like this has never existed, I think. Uh we try to bring together cell state chemists, cell state physicists, experimentalists, theorists, hardware engineers, all the experts, computer scientists. Um and some of these technologies are very recent. Like the high throughput experimentation, the robotic arms have only been tried in the last three years or so.β
βThe force field expertise, one of these force fields are also very recent. Um but yeah, we felt like having a lab is very important, having Having this focus and bringing all these people together to work together is very important. And I guess like the closest examples from history are places like Bell Labs, where incredible theorists and experimentalists and chemists worked together and achieved incredible things.β
βHaving this focus and bringing all these people together to work together is very important. And I guess like the closest examples from history are places like Bell Labs, where incredible theorists and experimentalists and chemists worked together and achieved incredible things.β
βNow our reinforcement learning environments literally derive from the environment, from our physical labs. Our data comes from our physical labs. And this is sort of our ultimate truth.β
βIt's not enough just to do optimization against some answers that were known in some papers or textbooks because we're going beyond that.β
βissues of say decision making under uncertainty so when you're doing optimization against math there's a high precision to it you're not really dealing with you know kind of variance or uncertainties or you know aberrant measurements whereas that's very key to to our process like for example when we are doing materials discovery loop things don't come off the out of the furnace labeled right even the labeling process can be stochastic and noisy and sometimes you'll have aberrations between different machines, maybe we'll have insufficient telemetry so we thought we ran at this temperature but really the temperature was some delta away and an intelligence that can take in this noisy data and make intelligent decisions like a scientist would is a sort of a different set of reasoning strategies.β
βmaybe we'll have insufficient telemetry so we thought we ran at this temperature but really the temperature was some delta away and an intelligence that can take in this noisy data and make intelligent decisions like a scientist would is a sort of a different set of reasoning strategies.β
βThere's a huge amount of commonalities. So the standard mid-training, reinforcement learning, the construction of tool-using agents, variance reduction, you know, making sure infrared doesn't have mismatches between like training and inference.β
βBut we have to go beyond that and really think about how do you do accurate work when there's a high amount of uncertainty? How do you make really incredibly efficient use? of a limited set of data.β
βSo we're scaling things up significantly, but still it's very different than a digital environment where you can arbitrarily add more environments or more rollouts. We don't have that same capacity. So sample efficiency is another key thing.β
βI think every scientific experiment has to do some dimensional deduction.β
Claim: Scientific experiments require reducing a system's dimensions to a manageable representation.
βAnd this is very different than coding or math. When you're doing math or coding, all the context could be available to the human or the LLM. It's a bunch of axioms, some corollaries people have derived from them. It's a bunch of like functions and API calls. So everything you need to reason through is available to you. And then you just have to be very smart and figure it out.β
βIn physics, as you know, we start with more atoms than we could ever store on a computer. So clearly we'll have to go from. the original number of dimensions and bits that represent a system to the number of bits we can fit in the computer.β
βAnd, you know, this was, I guess, the original premise of thermodynamics. They were originally really confused about how steam engines worked.β
βBut then turns out you can find like five or six thermodynamic variables that explain what's going on pretty well, which is incredible.β
Claim: A small set of five or six thermodynamic variables can explain steam-engine behavior quite well.
βwe've decided that energy, the average value of energy and the fluctuations of energy is very important.β
Claim: In theoretical physics, both the average energy and energy fluctuations are considered important.
βSo a lot of thermodynamics has been derived from this. And then we realized reaction barriers.β
βSo a lot of thermodynamics has been derived from this. And then we realized reaction barriers. There's are also very important the kinetics is very important Umβ
Claim: Reaction barriers and kinetics are important considerations in understanding material systems.
βso a human can try to reason through this extremely complex system by coming up with some, you know, reduced dimensionality descriptors umβ
βPeople also really like atomistic picture, like do you think about what the local neighbourhoods look like, whether they're from octahedra, tetrahedra, and that especially chemists really benefit from that. Um okay, so that's on the theoretical side and on the experimental side you would try to collect as much data as possible. So you'd have a lab notebook and you'd write everything you see etcetera.β
βPeople also really like atomistic picture, like do you think about what the local neighbourhoods look like, whether they're from octahedra, tetrahedra, and that especially chemists really benefit from that. Um okay, so that's on the theoretical side and on the experimental side you would try to collect as much data as possible. So you'd have a lab notebook and you'd write everything you see etcetera.β
βBut with the understanding of course that you'll miss a lot. Uh so like as Liam mentioned there are all these issues that come up. For example, yourβ
Claim: Experimental records inevitably omit some relevant observations or information.
βyour furnace will degrade over time, because as you're using the furnace, some of the things you're baking will evaporate and cover the heating element. So every time you use a furnace it gets worse and worse. Uh another issue is like you have a furnace but the temperature isn't perfectly uniform, so where you put in the furnace will affect the result. Uh we we don't have this issue yet, but we will maybe someday. The optical instruments uh suffer a lot from vibrations.β
Claim: Vibrations can significantly affect optical instruments.
βyour furnace will degrade over time, because as you're using the furnace, some of the things you're baking will evaporate and cover the heating element. So every time you use a furnace it gets worse and worse. Uh another issue is like you have a furnace but the temperature isn't perfectly uniform, so where you put in the furnace will affect the result. Uh we we don't have this issue yet, but we will maybe someday. The optical instruments uh suffer a lot from vibrations.β
βyour furnace will degrade over time, because as you're using the furnace, some of the things you're baking will evaporate and cover the heating element. So every time you use a furnace it gets worse and worse. Uh another issue is like you have a furnace but the temperature isn't perfectly uniform, so where you put in the furnace will affect the result. Uh we we don't have this issue yet, but we will maybe someday. The optical instruments uh suffer a lot from vibrations.β
βlike I remember when I was doing my P_H_D_ one lap had this big issue, because sometimes their results would be very different than other times, and they brought it down to at a certain time in the night upstairs somebody would be walking. And that vibration affected the laser set-up. Um so yes, science is very hard, but that's what makes it special, right? The other thing Liam and I have been talking about is a lot of the current improvements focus on math and coding and theoretical computer science.β
βand they brought it down to at a certain time in the night upstairs somebody would be walking. And that vibration affected the laser set-up. Um so yes, science is very hard, but that's what makes it special, right? The other thing Liam and I have been talking about is a lot of the current improvements focus on math and coding and theoretical computer science. science because it's easier for your limbs, but in real life most things that require intelligence are actually more like science. Like there's a lot of uncertainty, there's a lot of noise, um there's a lot of missing context, but you have to be the intelligent being and figure out what to do next.β
βand they brought it down to at a certain time in the night upstairs somebody would be walking. And that vibration affected the laser set-up. Um so yes, science is very hard, but that's what makes it special, right? The other thing Liam and I have been talking about is a lot of the current improvements focus on math and coding and theoretical computer science.β
Claim: Science is difficult, and its difficulty is part of what makes it special.
βscience because it's easier for your limbs, but in real life most things that require intelligence are actually more like science. Like there's a lot of uncertainty, there's a lot of noise, um there's a lot of missing context, but you have to be the intelligent being and figure out what to do next.β
βI think like a really interesting point to build on that too is the optimal reasoning strategies to do math, to do theoretical computer science, to do these types of things may not be the optimal reasoning strategies to do science.β
βSo as part of the materials discovery loop, we have to first figure out what to make. So that's the stability of the atoms together. as well as do we expect it to have the properties we want so we don't just want a novel configuration of the atoms we want them when put together to have the property of interest next is how do you synthesize it how do you actually make the thing that's also non-trivial so even if you know something will hold together the process of actually you know what are the processing conditions to actually bring that forth is highly non-trivial but again like the thing once you've done those two steps and you've made something it doesn't come offβ
βas well as do we expect it to have the properties we want so we don't just want a novel configuration of the atoms we want them when put together to have the property of interest next is how do you synthesize it how do you actually make the thing that's also non-trivial so even if you know something will hold together the process of actually you know what are the processing conditions to actually bring that forth is highly non-trivial but again like the thing once you've done those two steps and you've made something it doesn't come offβ
βcome off labeled so you actually have to characterize that and figure out what you made so in that caseβ
βRather than thinking about the oral environment of we're just going to kick off an experiment, wait a couple days and try to do like an update on like, did you find a room temperature superconduct or not? That's completely infeasible.β
βcompletely infeasible because you don't have enough agents to reduce the variance sufficiently. The rollout time is going between the different instruments you're waiting. There's just There's just some physics limits of the experiments for the actual synthesis or furnace time.β
βSo it's just too slow, too noisy.β
Claim: The experimental process is too slow and too noisy for the described workflow.
βSo the way we think about the AI program is basically constructing agents around this set of data that we've produced.β
Claim: The AI program constructs agents around the experimental data produced by the team.
βAnd so in the case of characterization, you're looking for RL environments that are rewarding the identification of the phases actually present. are you able to, given the raw experimental data, fit that effectively?β
βSo the way we do this is we'll shoot x-rays at the material. X-rays have a frequency or a wavelength roughly measurable or commensurate to the spacing between atoms, so you get nice diffraction patterns that kind of give a fingerprint of the crystal structure.β
βDoing this identification of what actually is present is highly non-trivial.β
Claim: Determining which phases or structures are actually present in a material is highly non-trivial.
βAnd so some of our early AI work has been on basically producing systems to do this.β
βAnd this allows us to move much more quickly, too, because if you're running so many experiments, you really quickly become bottlenecked on your ability to understand what was produced.β
βBut again, now the reinforcement learning environment is fairly straightforward, which is you're going to reward the identification. of the phases present you're going to penalize spurious phases or things that don't have any like real chemical plausibility so that that's like a you know a little sustaining thing where you can kind of do this for the different pieces and when you stitch this together that's the end-to-end discovery loop andβ
βanother another piece would be as we build up a large basket of experimental data you can think of another thing of basically like time stamping the state of the world so you could say at this date this was our experimental evidence up until that point and you can construct reinforcement learning environments where you say okay given that body of experimental evidence and given you know the choices what what was like the the next choice that the scientists made or what was an outcome of that experiment and this is really interesting too because this allows us to do youβ
βdo types of programs that would be harder externally because if the pre-trained model has already memorized some of this data and then you try to do reinforcement learning on that, if it already knows the answer and you construct reinforcement learning tasks that depend on that answer, it can fake work. so it doesn't actually have to do the hard physics reasoning. It doesn't have to actually...β
βafter actually do the the calculation simulations and it gets to the right answer and then you reinforce that policy and you upweight those reasoning strategies those reasoning strategies will not generalize to novel systems so it's not useful to us but as we build up baskets of experimental data and like stitching things together having the lineage the whole process that gives us the ability to construct new types of environments that are just not plausible elsewhereβ
βafter actually do the the calculation simulations and it gets to the right answer and then you reinforce that policy and you upweight those reasoning strategies those reasoning strategies will not generalize to novel systems so it's not useful to us but as we build up baskets of experimental data and like stitching things together having the lineage the whole process that gives us the ability to construct new types of environments that are just not plausible elsewhereβ
βyeah so there are a couple of things going on here so i think first of all we're definitely not done with any of the laws of physics like even theβ
Claim: Humanity has not yet completed its understanding of any of the laws of physics.
βSo there's a very common story people talk about, like when Dirac was figuring out quantum mechanics, like late 1920s, he wrote a textbook about quantum mechanics and he kind of framed it as a soul done.β
βAnd then there's a phrase people like to quote, I'm not sure actually how accurate it is, but apparently Dirac said, the rest is chemistry.β
βhe could maybe solve like a chain of one D_ hydrogen atoms. But then he cannot currently solve say nitrogen interacting with oxygen. But that's okay, that's just chemistry.β
βYeah, but it turns out I think what we learned in the last hundred years is first of all that's not true.β
βum it's not like a simple extension of what it was to do just hydrogen. And it's not just the rest is not just chemistry, there's actually a lot of physics there. I mean I guess one of the things we still haven't figured out is high temperatures for conductivity. But there are other other things.β
βum it's not like a simple extension of what it was to do just hydrogen. And it's not just the rest is not just chemistry, there's actually a lot of physics there. I mean I guess one of the things we still haven't figured out is high temperatures for conductivity. But there are otherβ
Claim: Scientists have not yet figured out high-temperature conductivity.
βWhen people say high temperatures for conductivity, what they mean there is unconventional superconductivity. So there is the conventional superconductivity that's just mainly driven by electron phonon coupling. And in that case you can kind of see the isotope effect.β
βhope effect. Like if you take the same system but just different weight for one of the elements, you can see the superconducting temperature drops at the rate you expect. So that one is conventional. But then higher temperature superconductors like cuprates, like the ones that are above seventy seven Kelvin like ninety three Kelvin turns out don't obey that physics. Or we don't know what physics they obey.β
βhope effect. Like if you take the same system but just different weight for one of the elements, you can see the superconducting temperature drops at the rate you expect. So that one is conventional. But then higher temperature superconductors like cuprates, like the ones that are above seventy seven Kelvin like ninety three Kelvin turns out don't obey that physics. Or we don't know what physics they obey.β
βUm they're just incredible superconductors.β
Claim: The speaker characterized high-temperature superconductors as remarkable superconductors.
βUm but it's not just that. So that definitely is one of these like very uh popular topics we don't know the theory yet for yet, butβ
βBut there's so many other things we don't understand. Like for example, even strong correlation in simple quantum mechanical systems we cannot simulate yet.β
Claim: Even strong correlation in simple quantum-mechanical systems is not yet simulatable by scientists.
βDensity functional theory is a very powerful tool. It's incredibly accurate on some things. But as long as as soon as there's like some strong electron correlation,β
Claim: Density functional theory is a powerful method that is highly accurate for some problems.
βDensity functional theory is a very powerful tool. It's incredibly accurate on some things. But as long as as soon as there's like some strong electron correlation, it actually fails to capture some of the effects.β
Claim: Density functional theory fails to capture some effects in systems with strong electron correlation.
βI mean there's so much to figure out. That's why I'm really excited for AI to be applied to this field because theoretically computationally and experimentally there's so much to figure out and every improvement we make here should improve human life because you know the better we can understand material solid state physics the better devices we can make for them.β
βI mean there's so much to figure out. That's why I'm really excited for AI to be applied to this field because theoretically computationally and experimentally there's so much to figure out and every improvement we make here should improve human life because you know the better we can understand material solid state physics the better devices we can make for them.β
βwhich is basically you may understand all the basic laws of something, but when you... You add many things they behave qualitatively distinct differently from how the simple like physics should tell you So understanding how lots of things behave together It seems like it should be simple like beginning laws are simple,β
βYou add many things they behave qualitatively distinct differently from how the simple like physics should tell you So understanding how lots of things behave together It seems like it should be simple like beginning laws are simple, but the collective behavior is so complicated that it's really hard to modelβ
βit's like emergent and universal which is crazy and there are also things with deep learning models right like we see power laws everywhere in deep learning we don't understand but it's like it's very reminiscent reminiscent of physics where there is emergence and universality.β
βit's like emergent and universal which is crazy and there are also things with deep learning models right like we see power laws everywhere in deep learning we don't understand but it's like it's very reminiscentβ
Claim: Collective behavior in complex systems can display emergence and universality.
βMaybe going back to the conversation we had about how since there are more than Avogadro's number of atoms, we'll never know the exact context of what happened. I think there might be a reason why we'll never be able to reverse engineer everything perfectly. But we're just trying to reverse engineer sufficiently to be able to improve the the performance of the material basically.β
βThere's a lot of progress we can make in terms of these like, you know, splitting up these agentic workflows to these different areas.β
βI think there's a lot of like empirical work we can make on synthesis prediction as well.β
Claim: SPEAKER_01 believes substantial empirical work remains to be done on synthesis prediction.
βI mean we kind of talk about like one of our missions as like synthesis super intelligence so I think it's in line with thisβ
βPhase transitions are fascinating. I mean, I think maybe the one that people can most easily relate to in their life is ice melting probably or water boiling.β
Claim: SPEAKER_02 identifies ice melting and water boiling as familiar examples of phase transitions.
βLike, you know, you increase the temperature of ice and it still looks like ice and it behaves like ice, but there's a certain temperature at which it just... stops raising its temperature and then turns into liquid.β
βSo it suddenly goes from this solid phase to liquid phase.β
Claim: SPEAKER_02 characterizes melting as a sudden transition from solid to liquid.
βAnother one that's very relevant to us of course is the icing model.β
Claim: SPEAKER_02 says the Ising model is relevant to the lab's work.
βAnd I think computer science and mathematicians also study this maybe under different names.β
βBut basically you can have spins up and down and they have different interaction terms if they're both up versus one is up one is down.β
βAnd at high enough temperature they're usually just randomly up or down, entropy wins.β
βspins, you lower the temperature, it's still looking the same, but then at some point suddenly they perfectly set aligning, yeah, the phase transition.β
βPhase transition is really nice because it makes physicists life easier for studying certain things.β
Claim: SPEAKER_02 says phase transitions make some phenomena easier for physicists to study.
βThey tend to have certain spatial correlations that really help us as well.β
Claim: SPEAKER_02 says phase transitions tend to exhibit spatial correlations that are useful to the lab.
βso in our lab phase transitions come about usually because we mix the precursors that are different crystals basically,β
βraise the temperature or do something else to encourage them to react and then atoms start reacting and they form into this new crystal and this shows up in the XRD pattern because usually if the geometry of the atoms change drastically the XRD pattern changes a lot but what really happens in like a typical practical materials discovery campaign is when you first try something it doesn't work and the outcome isn't just like a clear yes or no but it's usually like a very mixedβ
βraise the temperature or do something else to encourage them to react and then atoms start reacting and they form into this new crystal and this shows up in the XRD pattern because usually if the geometry of the atoms change drastically the XRD pattern changes a lot but what really happens in like a typical practical materials discovery campaign is when you first try something it doesn't work and the outcome isn't just like a clear yes or no but it's usually like a very mixed mixed phase.β
βraise the temperature or do something else to encourage them to react and then atoms start reacting and they form into this new crystal and this shows up in the XRD pattern because usually if the geometry of the atoms change drastically the XRD pattern changes a lot but what really happens in like a typical practical materials discovery campaign is when you first try something it doesn't work and the outcome isn't just like a clear yes or no but it's usually like a very mixedβ
βIt will usually have some of the precursors,β
Claim: SPEAKER_02 says mixed-phase outcomes usually retain some of the precursor material.
βit might have some amorphous phase and then it will have like a bunch of phases that you maybe didn't try to make.β
βSo that becomes a challenge. And that's why we found it very difficult to bring together simulations and AI to do the characterization.β
βSo the simulations can always say, oh this phase doesn't look like what we predicted but it's like slightly variation of it. Let me now do force field calculation to see if it's still stable. Or like the AI can sayβ
βBased on the previous experiment this one. This is probably not the phase we want to make so let's change the conditions.β
βXRD is x-ray diffraction, which you already described. Yeah, in some cases there's like a phase that just hasn't been recorded before. It doesn't exist in any papers or database and so the AI has to actually go and sort of put, use these tools to say well what configuration atoms would actually explain these phases. But this becomes incredibly important for direct.β
Claim: SPEAKER_01 says some observed phases have not previously been recorded in papers or databases.
βXRD is x-ray diffraction, which you already described. Yeah, in some cases there's like a phase that just hasn't been recorded before. It doesn't exist in any papers or database and so the AI has to actually go and sort of put, use these tools to say well what configuration atoms would actually explain these phases. But this becomes incredibly important for direct.β
βIt doesn't exist in any papers or database and so the AI has to actually go and sort of put, use these tools to say well what configuration atoms would actually explain these phases. But this becomes incredibly important for direct.β
βIt doesn't exist in any papers or database and so the AI has to actually go and sort of put, use these tools to say well what configuration atoms would actually explain these phases. But this becomes incredibly important for direct.β
Claim: SPEAKER_01 says phase interpretation is important for directing the scientific process.
βdirecting the scientific process because let's say we have a phase target in mind we really need to sort of hill climb that to get better measurements on that so if it's a one percent and we're like actually we want to increase this phase parity we want to have a very good measurement on this experimental data to say you know what is present what's notβ
βdirecting the scientific process because let's say we have a phase target in mind we really need to sort of hill climb that to get better measurements on that so if it's a one percent and we're like actually we want to increase this phase parity we want to have a very good measurement on this experimental data to say you know what is present what's notβ
βdirecting the scientific process because let's say we have a phase target in mind we really need to sort of hill climb that to get better measurements on that so if it's a one percent and we're like actually we want to increase this phase parity we want to have a very good measurement on this experimental data to say you know what is present what's notβ
βI think there's still ambiguity in a lot of these cases.β
Claim: Many cases of identifying material phases remain ambiguous.
βI mean, I think there, you know, it's a challenging task because it's not just a. fully deterministic and there are like well there there are like ambiguities and other thingsβ
βTwo different phases can't actually be consistent with the same pattern.β
Claim: A single measurement pattern can be consistent with two different material phases.
βAnd so I think that's why it's really important for the system to use some chemical intuition to say like, OK, this would be highly unlikely given the synthesis conditions, given this prior knowledge. And so that can be used to help disambiguate.β
βYeah, I mean I think thermodynamics is the biggest prior,β
Claim: Thermodynamics is the most important prior for interpreting material experiments.
βAnd then physics is a big prior.β
Claim: Physics provides an important prior for interpreting material experiments.
βAnother one that we really benefit from here is multi-modality or materials characterization.β
Claim: Using multiple forms of materials characterization benefits the team's analysis.
βSo like we can do XRD and yes some phases might look similar on the XRD pattern but then we can also measure their electrical properties, magnetic properties.β
βWe can measure their morphology like some kind of electron microscopy and then some of the phases that look similar on XRD will look different. to look different than some of these dimensions.β
βAnd that kind of multimodality really helps.β
Claim: Combining multiple measurement modalities helps analyze materials.
βAnd again, AI is really helpful there because like humans have limited context and computation power as well.β
βSo if you give humans like 10 different modalities at the same time and say, analyze these all consistently, it's a bit difficult.β
Claim: Humans find it difficult to analyze ten different data modalities consistently at once.
βBut it's actually not super intelligent for an AI to do it.β
Claim: Analyzing multiple data modalities is not especially demanding for an AI.
βYeah, it's like the superintelligence is it can just do so much calculations, they can look at everything.β
Claim: A superintelligent system can perform many calculations and examine all available information.
βabout like this is better decision making under uncertainty where now it's stitching together the signal across many different instruments longitudinally across different experiments across the replicates and kind of getting to this like underlying better model rather than just over indexing on one measurement from one instrumentβ
βYeah, so we don't throw away data. I think maybe what I meant was potentially, like if God was observing the experiment. there is more data in the experiment than humans can fit in a computer. Unfortunately, us mortals cannot observe all the atoms. So even though there's more data than we could store, we actually can't access that data. For example, I cannot trace all the atoms positions. So unfortunately, we're still in a regime where any data we collect is very precious and we don't delete any of it.β
Claim: The team retains all collected data because the data is precious and is not deleted.
βlike if God was observing the experiment. there is more data in the experiment than humans can fit in a computer. Unfortunately, us mortals cannot observe all the atoms. So even though there's more data than we could store, we actually can't access that data. For example, I cannot trace all the atoms positions.β
βSo you know in 1800s people realized that entropy of a system has to increase or like for a closed system or stay the same but it can't go down as the second law of thermodynamics.β
βAnd there was a thought experiment that was asking what would happen if there was a very tiny all-knowing demon that could kind of look at atoms. And then whenever an atom had low energy, kind of open a door and let it into this other room and keep doing this to reduce entropy of the system,β
βAnd then whenever an atom had low energy, kind of open a door and let it into this other room and keep doing this to reduce entropy of the system, which would break second law of thermodynamics. And for a long time I think there wasn't like a very satisfying answer for why that was the case, but then there was a more recent paper in the nineteen hundreds um more recently to us uh Landauer came up with the argument that you'd have to spend energy to delete information.β
βwhich would break second law of thermodynamics. And for a long time I think there wasn't like a very satisfying answer for why that was the case, but then there was a more recent paper in the nineteen hundreds um more recently to us uh Landauer came up with the argument that you'd have to spend energy to delete information.β
βthey have access to so much information by doing this thing he's doing that he'd have to delete some and when deleting information he'd have to spend energy which would then make sure entropy increases so even though we're not at the level where we can be Maxwell's demon I think your question is like very visionary towards like a future where we store so much data we have to delete someβ
βthey have access to so much information by doing this thing he's doing that he'd have to delete some and when deleting information he'd have to spend energy which would then make sure entropy increases so even though we're not at the level where we can be Maxwell's demon I think your question is like very visionary towards like a future where we store so much data we have to delete someβ
βwe add a huge amount of telemetry. And that basically reduces the number of like hidden variables, if you will.β
Claim: The speakerβs organization adds extensive telemetry to reduce the number of hidden variables.
βYeah we could I mean we have plans to you know open more labs alsoβ
Claim: The speakerβs organization plans to open additional labs.
βlike expertise can change right like here we have certain kinds of expertise for example Stanford physics department engineering department has certain kinds of expertise that really it helps us because we can hire from there, our researchers can collaborate, like as you said, that geography can matter. But then different cities can have some differences of expertise, just in physics, chemistry.β
βit helps us because we can hire from there, our researchers can collaborate, like as you said, that geography can matter. But then different cities can have some differences of expertise, just in physics, chemistry.β
Claim: Expertise in fields such as physics and chemistry varies between cities.
βYeah, I mean the future of periodic is is not a single lab.β
Claim: Periodicβs future will not consist of only one lab.
βI mean, I think it's necessary to have this sort of network of labs and like, yeah, I think as they're just kind of pointing out, like there's an optimal place for each of these based on expertise or, you know, materials constraint. There's many different constraints permitting.β
βYeah, so I mean one thing that's really helpful here is there are certain things that are easier to do in simulation and more accurate in simulation. There are certain things that are easier to experiment and more accurate in experiment.β
βI mean, in general, of course, experiments are more accurate, but certain measurements are very hard to make with experiment.β
βSo you make a bad version of it so you get inaccurate data.β
βuse density functional theory to estimate formation enthalpy of materials andβ
Claim: The speakerβs lab uses density functional theory to estimate materialsβ formation enthalpies.
βdensity functional theory is probably the most commonly used simulation method for materials it kind of comes from Kohn-Hohenberg theorem and Kohn got a Nobel Prize for this when he realized that sure quantum mechanics is very expensive becauseβ
βdensity functional theory is probably the most commonly used simulation method for materials it kind of comes from Kohn-Hohenberg theorem and Kohn got a Nobel Prize for this when he realized that sure quantum mechanics is very expensive because you basically have this exponential Hilbert space for every wave function. So you have to solve this like very difficult problem, especially as the system size grows.β
βCone and Hohenberg realized that turns out you don't need to deal with an exponential space, all you have to do is think about the charge density, at least for the ground state of quantum mechanical systems. So it's actually the theorem is pretty simple, so even I think an undergraduate in physics can understand,β
βbut the idea is all the properties of a quantum mechanical system ground state is a functional of the charge density.β
βYeah, which is amazing because charge density is just this three-dimensional object, whereas the Hilbert space and wave functions are exponential. Um so that was a really interesting observation and then Cohen published another paper, I think with his post-doc uh Sham, Cohen-Sham uh wave functions kind of had a practical way to solving s Some approximation of quantum mechanical properties of materials.β
βYeah, which is amazing because charge density is just this three-dimensional object, whereas the Hilbert space and wave functions are exponential. Um so that was a really interesting observation and then Cohen published another paper, I think with his post-doc uh Sham, Cohen-Sham uh wave functions kind of had a practical way to solving sβ
βAnd today we use it very much both in our lab and externally.β
Claim: Density functional theory is used both in the speakerβs lab and outside it.
βAnd then formation enthalpy is one of the measurements we can make to understand the energy of the material. Like basically we want to ask what is the energy that this material has?β
Claim: Formation enthalpy is one measurement used to assess the energy of a material.
βBecause if that energy is higher than other materials these atoms can come into, then it's unlikely that this material will be able to be made.β
βSo stable just means like it's on the comeback soil of other materials and their energies.β
βSo like density functional theory is a way of taking something which is exponentially hard in number of electrons or number, you know, in your system size and then reducing it approximately with some introduced error to like maybe usually an in cubed approximation.β
βYou can now compute things which are just uncomputable, but at some cost.β
Claim: DFT makes some otherwise uncomputable quantities computable, but doing so has a cost.
βHeather Kulik had said she famously said there is no alpha fold for materials, not just computationally, but the ground truth just doesn't exist.β
βLike we don't really know what material crystal structures look like.β
Claim: The speaker says that material crystal structures are not really known.
βYeah, I think so. I mean maybe two things I would add is, DFT by definition doesn't have to be an approximation. That the Kohn-Hohenberg theorem shows it can be exact,β
βbut I think as you're pointing out, the exchange correlation functional we don't yet have access to, and then for the charge density-based model we don't know what the kinetic energy functional is.β
βAnd then, even if we had perfect DFT, I still think we'd need a lab. Because even if you're perfect DFT, we cannot fit ten to the twenty three atoms in the computer.β
βYeah. No, okay, okay. Yeah, but with exponentially growing compute, you can argue that in in cube scaling size, eventually you could in principle calculate things. You just wait till Moore's But as long as you know, yeah, yeah. But as long as in cube is a good scaling, you canβ
βI personally don't know of a better method to predict. predict the stability of a new material it's definitely not perfect but it's definitely better than other methods i can think of and yeah so going back to your question the reason we use them is for certain things it's easier to simulate than experiment and they kind of complement each other well and then we can like do these in a loop like we feel like simulations will never be enough by themselves but in the loop of simulations ai and experiments youβ
βpredict the stability of a new material it's definitely not perfect but it's definitely better than other methods i can think of and yeah so going back to your question the reason we use them is for certain things it's easier to simulate than experiment and they kind of complement each other well and then we can like do these in a loop like we feel like simulations will never be enough by themselves but in the loop of simulations ai and experiments youβ
βAnd I think we can make progress much faster than before.β
βOne thing that simulations let you do is scale up much more quickly. I mean, because now like compute is much easier to bring online than bringing in bringing on new labs.β
βeven if we can do, as you said, 100 million trials with EFT, we could never actually try their microstructure.β
βAnd microstructure is this idea that like EFT usually stimulates the perfect crystal, but crystals usually actually aren't perfect.β
Claim: EFT typically simulates ideal perfect crystals, whereas actual crystals are usually imperfect.
βAnd their microstructure, which is the structure at like a medium order, can really affect the properties.β
Claim: The medium-order microstructure of a material can substantially affect its properties.
βOther issues, of course, like some properties like superconducting temperature cannot be easily simulated by D_F_T_ Again, like even if you do hundred million trials with D_F_T_ it won't be enough. So we have to rely on heuristics, experiments, etcetera.β
βUh like, for example, for a long time materials project which was the best opens for open source DFT database use experimental calibration for DFT. So they would actually use experimental data to calibrate DFT.β
Claim: The Materials Project calibrated DFT using experimental data for its open-source materials database.
βWe also do this internally here, like whenever there's a certain chemical system we're interested in, you get experiments, you get simulations and you can calibrate them.β
βBut do you not feel like organic chemistry and biology almost stem from a lower VC dimension, like lower chromogero complexity model, like you can almost represent as a 1D sequence, and it can almost be compiled. So like there's a sense in which it's a uh simpler in the common world complexity sense.β
βI think most people would argue it's more 2D, but yeah.β
Claim: The speaker says most people would characterize DNA as more two-dimensional than one-dimensional.
βVirtual is crazy. It's clearly not coming from such a low cholemic complexity model because that 3D inorganic crystals can host metals, insulators, superconductors, diamonds.β
βLike people tried but we could never find a 1D representation.β
βLike it's very hard to find a smile string for 3D inorganic crystals.β
βAnd the way the atoms interact with each other is quite strange like covalent bonds, ionic bonds, metallic.β
Claim: Inorganic crystals can involve covalent, ionic, and metallic bonding between atoms.
βthere are all these dendrites that form like basically the lithium will form these structures that go into salt electrolyte and crack it and you look at that and you think this is so primitive compared to biology like in biology these systems can do such complex nanotechnological technological progress whereas we can't even like make two interfaces work with each other because lithium will break it yeah but then I guess inorganic stuff can be very resistant to high temperatureβ
βthere are all these dendrites that form like basically the lithium will form these structures that go into salt electrolyte and crack it and you look at that and you think this is so primitive compared to biology like in biology these systems can do such complex nanotechnological technological progress whereas we can't even like make two interfaces work with each other because lithium will break it yeah but then I guess inorganic stuff can be very resistant to high temperatureβ
Claim: Lithium dendrites can grow into and crack a solid electrolyte.
βthere are all these dendrites that form like basically the lithium will form these structures that go into salt electrolyte and crack it and you look at that and you think this is so primitive compared to biology like in biology these systems can do such complex nanotechnological technological progress whereas we can't even like make two interfaces work with each other because lithium will break it yeah but then I guess inorganic stuff can be very resistant to high temperatureβ
Claim: Some inorganic materials can withstand high temperatures.
βYou can make space shuttles, you can make silicon, compute Moore's law. So yeah, it's a trade-off.β
βyeah yeah yeah yeah but maybe even just like more specifically for um like if you just look at an x-ray you had a perfect crystal and you shoot an xrd at it and you get the you know you get the spectrum that still doesn't actually tell you uniquely what the what the crystal structure is right no so and that's something that what yeahβ
βit's just average it's just average behavior but like for example disproportionation is a very complicated thing right where it's possible that you're the perfect crystal and on average it looks like it's perfect XRD but in reality there is some other pattern going on where like atoms slightly shift to the right or left but on average they're in the middle yeah it's a difficult life yeahβ
βwhen we started the science pod there were all these like elements of AI and science AI and math AI and physics and all these things and there was this like kind of pissing contest like which is harder and like I think like you can make the scientific argument that material science is the hardest.β
βWell, we didn't pick it necessarily for hardness. I mean, because actually like a lot of areas where it is easier. I mean, we have these like great simulators for large classes of materials,β
βit's incredibly difficult to model a cell or an organ or a full organism.β
Claim: Modeling a biological cell, organ, or whole organism is incredibly difficult.
βYeah, I mean you still get like different complexity at the different length scales for materials as well So yeah microstructure and beyond.β
βespecially if you can lower the dependence on rare earth or like transition metals that are hard to source like cobalt, reducing cobalt in batteries.β
βOne of the things I think is very fundamentally important is if we can get close to land our limit for compute energy efficiency.β
βso if you look at... How much energy we spend per like flop or compute? It is followed the Moore's law type behavior where it's gotten exponentially more efficient. So we've been spending exponentially less energy per flop or compute. I mean, I haven't checked recently. This was the case 10 years ago was.β
βAnd one of the things we have to do is dissipate heat because like as these computations are happening, it's producing heat, which has to happen. But then we have to dissipate it.β
Claim: Computations generate heat that must be dissipated.
βSo like if we can get close to the Landauer limit for how efficiently we do computation, that's amazing for humanity, right?β
βBecause that means now we're doing computation is probably one of the most fundamental things we do as humanity, but as efficiently as possible from energy perspective, which is a real currency in the universe.β
βuh so it definitely gets affected by reversible computing but honestly i'm not an expert i don't understand so if you can do reversible computing now you're not you don't actually have to spend energy to do computation because you're not actually deleting any information it's reversible uh but i don't know if that works i i don't know uh quantum computingβ
βI assume has to obey these laws somehow because they are so like they have to obey thermodynamicsβ
Claim: SPEAKER_02 assumes quantum computing must obey the laws of thermodynamics.
βOne of my most memorable conversations with Elon Gill was like he actually was a very skeptical person about quantum computing.β
Claim: SPEAKER_00 recalled that Elon Gill was very skeptical about quantum computing.
βIt's like even if you had it today, there's no applications.β
Claim: SPEAKER_00 said that quantum computing would have no applications even if it were available today.
βlike it breaks security,β
Claim: SPEAKER_00 said quantum computing breaks security.
βit. agree with that like like for them people talk about how if you're a quantum computer today you could could simulating so much better and I asked them okay let's accept that what would you simulate like you're still simulating perfect crystal like you still have the issues that DFT has if DFT was perfect in its prediction ability so yeah I do think people are kind of glossing over some things because quantum computing is so exciting like if we can compute in a quantum logic space instead of classical logic it's just so exciting that people are glossing over what it would actually do when it's madeβ
βcould simulating so much better and I asked them okay let's accept that what would you simulate like you're still simulating perfect crystal like you still have the issues that DFT has if DFT was perfect in its prediction ability so yeah I do think people are kind of glossing over some things because quantum computing is so exciting like if we can compute in a quantum logic space instead of classical logic it's just so exciting that people are glossing over what it would actually do when it's madeβ
βmade maybe that's fine because maybe once it's made it will do amazing things we can't even imagineβ
βIn the early days, as we were scaling things up, we realized that we had huge bottlenecks imposed just by operating machinery.β
Claim: SPEAKER_01 said that operating machinery became a major bottleneck as the lab scaled up.
βwe would have technicians and scientists looking for particular morphology and trying to see, what actually were we making, see if this is consistent with our intentions.β
βAnd we really quickly, as we scale up the lab, became into these bottlenecks where It just wasn't keeping up.β
βSo we started doing some programmatic approaches to capturing the data on SEM.β
βThe data that was being surfaced from this very simple program where it sort of takes a field of view, captures, zooms in, captures, was just not all that useful. It was a little too dumb for what we really wanted to account.β
βAnd so at that point, it was then really pertinent to build AI systems directly onto the machines to start controlling these things.β
Claim: SPEAKER_01 said the lab needed to build AI systems directly into its machines to control them.
βAnd now they have the full context as to what we're trying to achieve.β
βSo what was the intent of the experiment? What were we trying to synthesize? What were some other experimental evidence? And it's actually looking in the machine and capturing that data.β
βBut if you can do more intelligent data capture at the time of that experiment, your data for future AI systems and future computational predictions is that much better. You'll have. just a richer set of data.β
βyou know, everything on the lab has to be incredibly intelligent to just make the data as useful as possible.β
βAnd then there's sort of a timescale associated with different physical processes. And if calling out to an API or something is simply too slow, so the amount of reasoning or tokens or tool calls is just not matched to the latency of that actual process. process then that that's infeasible umβ
βultimately the experiments do take uh you know mini hours days but um There could be particular steps where latency would matter.β
βhow expensive it is because like the the same reason some of these models can be really slow in analyzing data also makes them very expensive and then finally the human patience like if a human wants the analysis of a certain xrd pattern and they have to wait two hours before they get a good result that's very different I think than if they can get it in like two minutes yeahβ
βmany, many tokens to kind of get to these patterns. not a single tool call. It's not a single inference thread. So then the latency can blow up quite a bit.β
βAnd then the other thing I think about is also, I guess, building up from small things to bigger things, where I assume that the general temptation or the typical development is incremental, where like everything is human operated, and then you find ways in which to automate it and then you sort of build up from there. I worry that sometimes that that is the way that people evolve things, but that's a local minima, optimum.β
βright exactly when like actually you should get a humanoid and just put them in thereβ
βwe we i think we're in the opinion that solving humanoids would actually be slower to kind of getting to some of our goalsβ
βwe we i think we're in the opinion that solving humanoids would actually be slower to kind of getting to some of our goalsβ
βyeah i mean i think like maybe one one process is um by having like a mix of uh like humans and automation, you can identify really quickly like what are some of the bottlenecks in the experimental process and you start alleviating those bottlenecks one at a time.β
βAnd so for example, if there's some really tricky dexterity task that humans are excellent at, but you'd have to spend months automating machine, maybe don't spend a ton of time there.β
βAnd maybe like a more promising thing is something very routine that takes up a huge amount of scientists and technicians.β
βtime and it's easy to automate so I think there's like this pragmatism to it but I mean ultimately what we want from the lab is a huge quantity of data high quality data diverse data and that those are our goals and full autonomy is a non-goal it's sort of in the service that we use automation in the service of achieving the goals on the dataβ
βbut also i mean i think another aspect to automation is uh robots will just be uh make fewer mistakes potentially in the lab and it's been really helpful having ai systems with a full view over all of our data because sometimes if there's like a permutation in data uh then it can identify it so for example one of our steps at one point had a cyclic error because one of the machines was loaded incorrectly and the patterns were inconsistent so the AI was reading through these things and says well given what was run this is not expected and it's looking at this basket of data longitudinally and then it realized if I do this like cyclic permutation and reverse it everything is consistent and then we're able to go back to the physical infrastructure and understand understandβ
βbut also i mean i think another aspect to automation is uh robots will just be uh make fewer mistakes potentially in the lab and it's been really helpful having ai systems with a full view over all of our data because sometimes if there's like a permutation in data uh then it can identify it so for exampleβ
Claim: The speaker thinks robots may make fewer mistakes in laboratory work.
βand that a mistake had been made in the loading and I think like managing data quality is so foundational to doing AI in the physical world and you know these are the types of things that we're building in and so you can improve the operating process but at that point you're like okay this is another great opportunity for automation how do you make this just so reliable so durable that we never have those types of mistakes againβ
Claim: The speaker considers data-quality management foundational for applying AI in the physical world.
βNoise floor experimental data I think is very important. Most experimental data in literature have such high noise floor that it's actually usually worse than DFT accuracy. Because you know when different people do experiments, different labs, different parts of the world, different times, it really introduces so much fluctuation to the result.β
βNoise floor experimental data I think is very important. Most experimental data in literature have such high noise floor that it's actually usually worse than DFT accuracy. Because you know when different people do experiments, different labs, different parts of the world, different times, it really introduces so much fluctuation to the result.β
βSo we are hoping that by standardising these workflows one of the biggest benefits will be that the noise floor will be lowered.β
βI mean, we basically use a mix of open source models and closed source models.β
Claim: The speakerβs team uses both open-source and closed-source models.
βWe're huge beneficiaries of this from our simulation side, building up the ML stack, the simulation stack.β
βWe don't need to push on that axis.β
Claim: The speaker says the team does not need to prioritize further progress on the simulation axis.
βBut there's a lot of areas where the latency is too high, the cost is too high.β
Claim: The speaker says latency and cost are too high in many areas where their systems are used.
βyou know, by having access to this data, we can actually push beyond the frontier of what these systems. can do under even some like the highest reasoning efforts and so it's not necessarily just about cost or Pareto efficiency but in some cases you can push beyond it when you have access to data that no one else has one way to characterize this is in terms of compute efficiencies so by having access to this data you can be that much more compute efficient compared to you know some of the frontier modelsβ
βcan do under even some like the highest reasoning efforts and so it's not necessarily just about cost or Pareto efficiency but in some cases you can push beyond it when you have access to data that no one else has one way to characterize this is in terms of compute efficiencies so by having access to this data you can be that much more compute efficient compared to you know some of the frontier modelsβ
βAnd that's been able, been like a really instrumental thing in our program.β
Claim: The speaker says access to data has been instrumental to the teamβs program.
βum i mean a null result could be we intended to produce some structure and then all of the evidence points to us not producing that structureβ
βexactly 100 percent um and a negative result you know in some cases is actually we intended to make the following thing and then we're actually able to identify a new structure that hadn't previously been identified. So it's negative in some respect, like we intended to do something else but something else emerged from the data.β
βYeah. And also in general, like when you're training a machine learning algorithm, especially like at a very basic level, if it's a classification. algorithm if you don't have negative samples you can't really train if everything is positiveβ
βthis is a particularly bad problem in material science because people usually publish crystals they could synthesize but they usually don't publish if they fail to synthesize a crystal sometimes they might and also like we never know really if a crystal is not synthesizable ever rightβ
Claim: The speaker says it is generally not known whether a crystal can never be synthesized.
βthis is a particularly bad problem in material science because people usually publish crystals they could synthesize but they usually don't publish if they fail to synthesize a crystal sometimes they might and also like we never know really if a crystal is not synthesizable ever rightβ
βthis is a particularly bad problem in material science because people usually publish crystals they could synthesize but they usually don't publish if they fail to synthesize a crystal sometimes they might and also like we never know really if a crystal is not synthesizable ever rightβ
βYeah, so I think it really helps us when we do our own experiments and get negative results in the context of what we tried. So then we can even train a classification algorithm.β
βthere's also like another valid thing too of when you have this sort of string of negative results and then finally through process iteration you're able to get to that positive result. It's a really interesting set of I'll call it like process engineering type data.β
βSo it's like through iteration how did you actually get to that correct result because so much of material science has this ambiguity and actuallyβ
βlike how something was made and so yeah and so there's actually even if there's a known material it can be highly non-trivial to replicate that some things are you know in like you know a high school textbook but other things are really at the frontier and you know we're building up that know-how as well and I'm building up a system that you know given the string of negative results how do you actually get to that positive caseβ
βlike how something was made and so yeah and so there's actually even if there's a known material it can be highly non-trivial to replicate that some things are you know in like you know a high school textbook but other things are really at the frontier and you know we're building up that know-how as well and I'm building up a system that you know given the string of negative results how do you actually get to that positive caseβ
βas you said like if you were doing per experiment labels it would be mostly negative. But if you were doing per campaign and assuming campaigns end when we succeed then it could be a bit more balancedβ
βThis type of data basically doesn't exist anywhere else. And we spend so much of our time getting the full lineage of the scientific process into the model.β
βAnd so like tracking all this data, like the conversations, the intuitions, what was executed in the lab or the... before the computations run or with the code written stitching all this together is is so valuable and I think like you know the overall goal is rather than training on the final output of science you're training on the process of doing scienceβ
βbefore the computations run or with the code written stitching all this together is is so valuable and I think like you know the overall goal is rather than training on the final output of science you're training on the process of doing scienceβ
βthe physics models you're developing are improving chips which then improve ai so this is the the widerβ
Claim: Developing physics models can improve chips, and improved chips can in turn improve AI.
βYeah, I mean, I think there's decision making under uncertainty, obviously in machine learning, there's there's noise in running like the AI loops. But we do think there's like a different set of challenges when you're actually like interfacing with the physical world.β
βIf inference time reasoning was sufficient, all of the frontier labs would have stopped training.β
βAnd so we think that by, you know, because of the differences between, you know, physical sciences and machine learning, getting that compressed into our own weights will lead to different types of systems and different types of capabilities.β
βBut also we feel like even if like Fable 7 gets really good at like even better than what it is today it will still have to run experiments to get results and the reason for it is right like machine learning is really good at what's been trained on but scientific discovery is almost by definition what you haven't been trained on and that's why we're building these labs so that whether open models or closed models can use these labs to tinker with the universe because we don't feel like you can make a big discovery without trying things.β
βit will still have to run experiments to get results and the reason for it is right like machine learning is really good at what's been trained on but scientific discovery is almost by definition what you haven't been trained on and that's why we're building these labs so that whether open models or closed models can use these labs to tinker with the universe because we don't feel like you can make a big discovery without trying things.β
βthere's not going to be like no one's going to like zero shot the room temp superconducting.β
βI mean, as someone who has worked closely with, you know, wet labs before, it's certainly I am more skeptical about zero shotting like scientific results than some,β
βbut it is something that I think some people might have.β
Claim: The speaker thinks some people may believe scientific results can be produced zero-shot.
βI mean, I think it's it's really important to distinguish the results we see in math and theoretical physics from. the physical world right like yeah these are two different thingsβ
βnot even theoretical physics like so far it's been theoretical computer science building and math. maybe theoretical physics is next.β
βit'll come yeah that's gonna be the next thingβ
Claim: The speaker expects theoretical physics to be the next area of work.
βSo one level is the atomistic structure. This is an abstraction, right? Like there is no perfect atomistic structure, anything we do, but it's one approximation.β
βAnother one is the continuum model. So this one is like not atomistic anymore, but it's a the continuous mesh representing the material.β
Claim: A continuum model represents a material with a continuous mesh rather than an atomistic structure.
βI mean from the beginning our hypothesis has been that one of the big bottlenecks is automated characterization because it's not that hard to mix powders to get to try stuff but if you can't characterize and analyze it and then decide what the next step should be intelligently you don't really benefit much. much from mixing powders randomly so we focused a lot on automated characterization closing the loop with simulations because that's how you like try a lot of things make an informed decision and then decide what to do the next dayβ
βmuch from mixing powders randomly so we focused a lot on automated characterization closing the loop with simulations because that's how you like try a lot of things make an informed decision and then decide what to do the next dayβ
βSo I mean, I think even just using like the guidance of campaigns in early days that was fully human driven. Now increasingly it's a mix of AI-driven and human-driven.β
βAnd then Ders was saying early on we identified that characterization was a big bottleneck in the early days. It was human-driven and the scientists were very much overwhelmed and the balance has shifted significantly towards AI-driven.β
βAnd this has allowed the scientists who are previously spending all of their time doing these refinements to now elevate their work to something else.β
βBut I mean, I think we're, it's really sort of a function of time. There's, it's always changing at these levels.β
Claim: The balance between human and AI involvement in the work changes over time.
βSo especially in simulations, people have been using evolutionary search, For a long time, um, like it's pretty good at structure prediction, for example, finding low energy structures.β
βAnd then uh the processor engineers in semiconductor industry will do DOE, design of experiments, and they'll often use some kind of zero order uh like whether it's Bayesian optimization or evolutionary search or I I don't think they use R_L_ but similar idea, yeah.β
βall zero order optimization behaves the same anyway, right? So.β
Claim: The speaker suggests that all zero-order optimization methods behave similarly.
βThe RLL environment is not quite trivially Run the experiment, wait for that agent to fully roll out, you know, doing the calculations, going through all the instruments to the final outcome.β
βWe basically start producing data across all the different instruments and all these different campaigns.β
Claim: The team produces data across its different instruments and experimental campaigns.
βAnd one way you can begin to expand that for machine learning is now reinforcement learning environments can be constructed based on, again, like gates for, you know, the experimental campaigns or computational campaigns.β
βat that point or you can also start taking subsets of instruments and you're like okay we're going to create reinforcement learning environments on the basis of this instrument alone or maybe it's across these different instruments to kind of get to some reward state so that's a way where this finite basket of data when viewed in different ways can then be expanded for training purposesβ
βSo it doesn't get at the actual experiment run, but from a Ml perspective.β
βSo, you know, one thing people have tried is combinatorial sputtering, and if you've ever heard of this, like you have these sputtering targets and you create this compositional gradient, so when you look at the final product, because there is gradient from each precursor, it creates different crystals at different spatial locations. So in one go you may You maybe try hundreds thousands of crystalsβ
βas far as I know this isn't worked very well so far because turns out like there is diffusivity so things move aroundβ
βAnother one that we thought about but we haven't done yet, but a lot of people talk about this is super conductivity measurements are a bottleneck because unlike XRD There's no high throughput conductivity measurement and can take like one hour per measurementβ
βSo people thought about taking the different candidates, mixing them all into one sample and putting it in. And if it has superconductivity, you know that one of the sources did.β
βthere are ideas like this exist. Some of them work well, some of them don't. Yeah.β
Claim: Some of the ideas being discussed work well, while others do not.
βAnd I think the resources allow us to continue to scale up the labs significantly, but also the compute both from like the AI side and the computational side.β
βSo I think we've been proving out this loop in our initial labs here in Menlo Park, but we'll be continuing to expand to new types of labs and repeat the same process.β
βlike the kind of lab we're trying to build I think haven't been built before at this scale or at this approach.β
Claim: Periodic Labs says its lab model has not previously been built at this scale or using this approach.
βSo we have learned a lot from our own build out so far and those lessons guide us for the next version and the next version and then we can as you said like increase the scale, the ambition, the quality of instruments.β
βSome instruments are very expensive.β
Claim: Some laboratory instruments are very expensive.
βAs we get a really good understand for what we get a lot of return from, we can invest into those more.β
βAnd it makes hardware engineering has become so core to it.β
Claim: Hardware engineering has become central to Periodic Labs' work.
βSo for example, in the early days, just for speed, we buy some off the shelf instruments.β
Claim: Periodic Labs initially bought off-the-shelf instruments to move quickly.
βAnd as we kind of push the scale of the lab, we have to make our own.β
Claim: Periodic Labs says increasing lab scale requires it to build its own instruments.
βokay, for this instrument, it's pretty fast, these components are actually pretty quick, but this weighing machine actually becomes the bottleneck.β
βOr there can be things pertinent to data quality where, well, the resting position of this robotic arm actually is above the plate of previously mixed things so there's a contamination risk so in our hardware design we're going to redesign it so that the resting position lies away from those things like these are the kind of subtle details that allow us to kind of push the noise floor down for our experimental campaign so basically take these learnings and scale it upβ
βSo we hire for AI research and infrastructure, computational, experimental roles, and hardware engineering roles, and then product roles.β
βWe want to achieve synthesis superintelligence, right? And weβ
Claim: Periodic Labs' stated goal is to achieve synthesis superintelligence.
βWe feel like for that we need the right chemistry expertise, the right physics expertise,β
βsimulation theory and thin films powder. So hardware engineering like these seem like very diverse roles which they are but they're all actually coherent in what they're trying to do which is a sensor for intelligence and this also applies to the LLM researchers, the infra, even the product engineers because the product engineers kind of make sure all the research gets made into. made into a product that the experimentals in the lab can use.β
βeven the product engineers because the product engineers kind of make sure all the research gets made into. made into a product that the experimentals in the lab can use.β
βso in order to do the end-to-end loop with the physical world, it really requires your ability to have agency over the physical world to build these labs, to run the campaigns effectively, to create AI systems against that, to make them good users of the computational tools.β
βThat's like the difficulty, but also the opportunity of periodic.β
Claim: Periodic Labs describes its work as both difficult and an opportunity.
βIt's like this group of people has just never been brought together before.β
βIrreducibly a multidisciplinary problem.β
Claim: Periodic Labs considers its research problem inherently multidisciplinary.
βand one other guiding principle for us that is really important for us is we want the people who are very good at what they do and experience to do it hands-on.β
Claim: Periodic Labs' guiding principle is for highly skilled, experienced people to perform hands-on work.
βYou know, like the modern life has gotten us to this place where, especially in academia, when someone is really good at research in some area, we give them so much responsibility for grant writing, teaching, that they stop having the time to do research in that area hands-on.β
βBut if you look back at like Bell Labs, IBM, institutions that made really good progress, it was really experienced people doing hands-on work like Bardin was in the lab every day, even though he's a theorist.β
βYes, Alex Mueller was in the lab doing experiments, even though he was the lab lead. So we try to do that here too. So we have some of the world's leaders in different fields, but they're doing hands on work.β
Claim: Periodic Labs says some of its field-leading experts perform hands-on work.
βOh, I would love to, yeah. So um you know i i when I was doing my PhD, my favourite computational material scientist who's kind of from my age group is Muratan Icoc. He did his PhD with one of our advisors, Chris Wolverton and he uh he is is kind of like our computational material science expert. He's incredible.β
Claim: Muratan Icok serves as Periodic Labs' computational materials science expert.
βHe's sometimes, you know, a really good experimentalist even though he does simulations. Like he understands systems really well.β
βOur lab lead is Joe Ciekalski who is a professor at MIT but he's on leave to work with us full-time. And Joe is this incredible physicist, understands superconductivity really well.β
Claim: Joe Ciekalski has strong expertise in superconductivity.
βOur lab lead is Joe Ciekalski who is a professor at MIT but he's on leave to work with us full-time. And Joe is this incredible physicist,β
βBut he also was a professor in Japan for a bit. So learned synthesis and chemistry. really well especially for a physicist.β
Claim: Joe Ciekalski previously taught in Japan and learned synthesis and chemistry.
βWe have Daniel Chica who was a graduate student in Mercury Kanazidis' group which is maybe the best solid state chemistry group in the world and Daniel was one of his like synthesis experts. So he's like a magician with his fingers. Um I mean there's so many examples like this.β
βNo, I know. I mean, I think like Dima Bahandar, so he's been leading a lot of our AI and LLM efforts.β
Claim: Dima Bahandar leads many of Periodic Labs' AI and LLM efforts.
βHe was the inventor of neural network attention.β
Claim: Dima Bahandar is credited by the speaker as the inventor of neural network attention.
βyeah so very hands-on and sort of getting into like you know the traces the training distribution how to connect it to the lab chemistryβ
βwas very deep um he actually has like solid state synthesis books like at his lab in montreal ray nacono so he used to tech lead some of the operator work at open aiβ
Claim: Ray Nacono previously tech-led some operator work at OpenAI.
βhe's in the lab so when we were doing some lab tours we were initially like oh this new scientist this new technician really looks like Ray and no it was literally this was Ray like actually in the lab with the scientists automating the machines and it's like this is sort of the the DNA and the type of people we need to kind of pull this off eventuallyβ
βhe's in the lab so when we were doing some lab tours we were initially like oh this new scientist this new technician really looks like Ray and no it was literally this was Ray like actually in the lab with the scientists automating the machines and it's like this is sort of the the DNA and the type of people we need to kind of pull this off eventuallyβ
Claim: Ray Nacono worked in the lab alongside scientists to automate machines.
βSo we've been building our own products, our own tools, our own AI and computational for ourselves. So we've been customer zero.β
βNow what we're doing is we're taking these same tools to different industries and we have a huge focus right now in the semiconductor industry. industry.β
βin order to do this, like these are very private companies we need to be able to operate within some of the most secure environments.β
βAnd so our periodic for deployed engineers and researchers will actually be on site working and actually integrating our AI systems or computational systems to help our partners get to their goal states more quickly.β
βSo basically the tools, the know-how that we've built. in doing our own materials discovery materials engineering we're now bringing to industry and we think this is the the most effective way to get partners to their end states and to their goals rather than just like throwing some technology over the wall and telling them to figure it out then these forward deployed engineers will also do the inference locally but then also can train on the data so againβ
βin doing our own materials discovery materials engineering we're now bringing to industry and we think this is the the most effective way to get partners to their end states and to their goals rather than just like throwing some technology over the wall and telling them to figure it out then these forward deployed engineers will also do the inference locally but then also can train on the data so againβ
βin doing our own materials discovery materials engineering we're now bringing to industry and we think this is the the most effective way to get partners to their end states and to their goals rather than just like throwing some technology over the wall and telling them to figure it out then these forward deployed engineers will also do the inference locally but then also can train on the data so againβ
βonce we take our system that understands these different areas and we deploy we can make it expert on the customers or the partners data so that they can own their own intelligence and have systems that understand this much more effectively than you know than just like hitting some API or some untrained model and so this is a much expanded for deployment engineering role than typical because this really requiresβ
βThere's some very deep machine learning expertise.β
βYou have to be incredibly precise from like a data training perspective, infrastructure perspective, but also physics perspective.β
βSo we're working with, you know, highly technical industries. They have to understand, you know, different areas of like chemistry, material science, some of the devices.β
βAnd so those are the roles we're building out right now.β
Claim: Periodic Labs is currently expanding its forward-deployment engineering roles.
βI think like a really great analog would be software engineering.β
βso in the early days of software engineering like we have like you know guess GitHub Copilot, then we had early versions of ChatGPT, people were using these things as co-pilots to help them get to their solutions.β
βAnd as the automation improves, now we have things like codecs and very few of our engineers are writing code the way they used to.β
βAnd we think a very similar thing could play out for periodic as well, where you can have systems to accelerate the researchers, the material scientists, the materials engineers, the process engineers,β
βbut as the autonomy intelligence. and capability grows, you can begin to price outcomes.β
βYeah, I mean we kind of feel like our best contribution to solid-state physics and science could be if we made these tools and topics profitable.β
βSimilar to how ChatGPT made CS and LLM majors way more popular in colleges.β
βBefore and after we love to show that solid-state physics material science research can make a big impact commercially and then that will attract more attention young people will want to study physics which will be a dream and you know Bell Labs did make a huge commercial impact right so they failed to commercialize some of their incredible advances they of course did some research that just couldn't be commercialized like the cosmic background but but they did benefit a lot from like the vacuum tubeβ
βBefore and after we love to show that solid-state physics material science research can make a big impact commercially and then that will attract more attention young people will want to study physics which will be a dream and you know Bell Labs did make a huge commercial impact right so they failed to commercialize some of their incredible advances they of course did some research that just couldn't be commercialized like the cosmic background but but they did benefit a lot from like the vacuum tubeβ
βConnecting East Coast to West Coast by phone lines.β
βYeah, and I think it's really also interesting to think that technology and capital are incredibly intertwined. So if you look at what was the progress on chatbots for many years,β
Claim: The speaker believes technological progress and capital are strongly interdependent.
βlike imagine recounting, okay, what was the progress from chatbots from, I'll say, 2010 to 2015? We'd be kind of at a loss to say over that five year period, how much did they improve?β
βWhereas if you look at the period from 2021 to 2026. You know, it's night and day.β
βAnd what happened was ChatGPT and these other systems were able to achieve a product market fit, and it changed the capital landscape entirely.β
βThis changes the landscape for hiring, compute, data, etc.β
βSo technology, it's incredibly coupled to the capital and those resources,β
βand we want to achieve the same thing in the physical world.β
βI mean, so we have a couple of things. So we have been contributing to open source to kind of like PyMedGen, the materials project, code base, custodian, their DFT runner, TorchSim was actually created by one of the researchers here, Abhijit Gangan, and he maintains it still, JAX-MD, Abhijit maintains it. So we do a lot of open source contribution.β
βTorchSim was actually created by one of the researchers here, Abhijit Gangan, and he maintains it still,β
Claim: Periodic Labs researcher Abhijit Gangan created TorchSim and continues to maintain it.
βAbhijit maintains it. So we do a lot of open source contribution.β
Claim: Periodic Labs describes itself as an active contributor to open-source projects.
βSGX, including LLVM, Megatron. Yeah, yeah. So we've been very active contributors back into open source.β
Claim: Periodic Labs says it has actively contributed to open-source projects including LLVM and Megatron.
βYeah, yeah. So we've been very active contributors back into open source.β
Claim: The company has actively contributed to open-source projects.
βAnd we also have an academic grant programme where we give academic gift grants to academic groups in universities that we feel like are really advancing this direction towards synthetic superintelligence.β
βI think the first paper from this funding is about to come out. So it will be exciting to just get more papers.β
Claim: The first paper produced through the academic grant funding is expected to be published soon.
βYeah, so I mean our view is that it's not hard to think of chemical spaces that would host superconductivity. What's really hard is to synthesize them.β
βThat's why we're really like emphasizing synthesis superintelligence. So maybe one example to give historically is Alex Mueller when he thought that transition metal oxides might be a good good path to superconductivity he was actually trying nickelates, the nickel oxygen and some uh cadions and that didn't work and then he tried cuprates, just copper copper oxygen and some cadions and that worked. And then he got a Nobel prize. But then we know that later on turns out nickelates was a good idea. I mean nickel and copper next each other onβ
βgood path to superconductivity he was actually trying nickelates, the nickel oxygen and some uh cadions and that didn't work and then he tried cuprates, just copper copper oxygen and some cadions and that worked. And then he got a Nobel prize. But then we know that later on turns out nickelates was a good idea. I mean nickel and copper next each other onβ
Claim: Nickelate materials later proved to be a promising direction for superconductivity research.
βhe realized he can make Nicolet's thin film formation with superconductivity.β
Claim: Harald Wang found a way to form nickelate thin films with superconductivity.
βyou know, if we have a really good synthesis for intelligence in the lab and we can really scale up these things, I think we won't run out of ideas or the LLM won't run out of ideas about what directions to try,β
βLike many people have been trying like cobaltates, which is like instead of copper or nickel, you try cobalt.β
Claim: Researchers have explored cobaltates by using cobalt in place of copper or nickel.
βMaybe one historical example to also study is the Japanese group that discovered magnesium diboride. As you know, that's the highest temperature ambient pressure conventional superconductor.β
βAnd they discovered it by just trying a bunch of materials.β
βI think they tried 30,000 different things. 30 of them seemed to host interesting superconductivity and MgB2 was one of them. But magnesium diboride set on people's shelves as a precursor for superconductivity.β
βSo four decades before then and BCS theory had been invented back in 1957.β
βSo the way people found these materials wasn't for directly from theory. It wasn't because they couldn't synthesize until then. It was just like they tried a bunch of things.β
βWe just really increased the surface area for luck.β