The speaker estimates an H100 GPU's FP16 throughput at about 10^15 FLOPs per second and gives a broad estimate of 10^12–10^18 FLOPs for the brain, depending on the counting method.

“your gpu is actually has pretty similar specifications to a human brain uh you know it like has sort of similar you know it is basically like similar in terms of like i think maybe the most important metric is just how many flops per second like how much total compute capacity does the brain have versus does the gpu have and for an h100 you know it's like 1e15 flop per second in fp16 for the for the brain you know it depends on exactly how you count and whether you use it”

“isn't synapse bases or neuron bases or whatever um but it's like you know somewhere between 10 to the 12 and 10 to the 18 flops so you know sort of like an h100 is like right dang nav in the middle of at least the log distribution over over that sort of order of magnitude you”