August 19th, 2024

Launch HN: Sorcerer (YC S24) – Weather balloons that collect more data

Sorcerer, a startup, is developing innovative weather balloons that operate for over six months, enhancing atmospheric data collection in under-monitored regions, potentially revolutionizing forecasting accuracy at lower costs than satellites.

ExcitementCuriosityAdmiration
Launch HN: Sorcerer (YC S24) – Weather balloons that collect more data

Sorcerer, a startup founded by Max, Alex, and Austin, is developing innovative weather balloons capable of operating for over six months. These balloons collect significantly more atmospheric data at a lower cost compared to traditional methods, addressing a critical gap in weather data collection, especially in under-monitored regions like Latin America, Africa, and oceans. The team identified the inadequacy of existing weather forecasts during their previous work at Urban Sky, where they struggled with inaccurate wind predictions due to a lack of high-quality data at higher altitudes. Sorcerer's balloons ascend and descend between sea level and 65,000 feet multiple times daily, gathering vertical data soundings essential for accurate weather forecasting. Each balloon is lightweight and can be launched globally, utilizing satellite communication and solar power for operation. The company aims to deploy hundreds of these systems to enhance weather data collection in data-sparse areas, potentially revolutionizing forecasting accuracy through unique data collection and AI model training. Sorcerer’s approach could allow for thousands of balloons to be maintained in the atmosphere at a fraction of the cost of a single weather satellite, providing a promising solution to the growing challenges posed by climate-related disasters.

- Sorcerer's weather balloons can operate for over six months and collect extensive atmospheric data.

- The startup addresses significant gaps in weather data collection, particularly in under-monitored regions.

- Each balloon is lightweight, can be launched globally, and uses satellite communication and solar power.

- The company aims to enhance forecasting accuracy through unique data collection and AI model training.

- Sorcerer's approach could allow for thousands of balloons to be maintained at a lower cost than traditional weather satellites.

Related

New NOAA GOES-U satellite will track weather for most of Western Hemisphere

New NOAA GOES-U satellite will track weather for most of Western Hemisphere

NOAA's GOES-U satellite, launched by SpaceX Falcon Heavy, will enhance weather observations with a solar coronagraph. Completing the GOES-R series, it ensures data availability for NOAA forecasters until the 2030s.

BOA27: An open source, open hardware, leafleting, smart balloon

BOA27: An open source, open hardware, leafleting, smart balloon

The GitHub project BOA27 aims to create a cost-effective smart leafleting balloon for North Koreans. It includes design, materials, navigation, payloads, and aims to provide crucial information access. Contact project contributors for more details.

Startups building balloons to hoist tourists 100k feet into the stratosphere

Startups building balloons to hoist tourists 100k feet into the stratosphere

Startups Zephalto, Space Perspective, and World View are developing high-altitude balloon rides for tourists, offering unique Earth views. Tickets range $50,000-$184,000. Companies are optimistic about consumer interest in this market.

Stratospheric Optical Earth Observation

Stratospheric Optical Earth Observation

Strat-Observer offers global stratospheric Earth observation services with optical payload for High Altitude Platforms. It complements Airbus' satellites, providing enhanced performance for defense, maritime, security, and environmental sectors. The system enables persistent surveillance and instant data access, supporting various applications.

It's always sunny in space: Michigan startup hopes to beam solar power to Earth

It's always sunny in space: Michigan startup hopes to beam solar power to Earth

Virtus Solis Technologies, a Michigan startup, aims to develop space-based solar power by launching modular solar cells into orbit, targeting a pilot plant by 2027 despite cost and safety concerns.

AI: What people are saying
The comments on the article about Sorcerer's innovative weather balloons reflect a mix of excitement and curiosity about the technology and its implications.
  • Many commenters express enthusiasm for the project and its potential to improve weather forecasting accuracy.
  • Several questions focus on technical aspects, such as data transfer, telemetry, and the handling of large data volumes.
  • There is interest in the regulatory challenges of launching balloons, especially in urban areas.
  • Commenters inquire about the environmental impact and cleanup of the balloons after their use.
  • Some users suggest potential collaborations or offer their expertise to assist with the project.
Link Icon 50 comments
By @jviotti - 6 months
Very cool! How are the balloons transferring telemetry back to earth for analysis, etc?

Asking because my research at the University of Oxford was around hyper space-efficient data transfer from remote locations for a fraction of the price.

The result was an award-winning technology (https://jsonbinpack.sourcemeta.com) to serialise plain JSON that was proven to be more space-efficient than every tested alternative (including Protocol Buffers, Apache Avro, ASN.1, etc) in every tested case (https://arxiv.org/abs/2211.12799).

If it's interesting, I'd love to connect and discuss (jv@jviotti.com) how at least the open-source offering could help.

By @johnsillings - 6 months
This is one of the most fascinating Launch HNs in a while. Excited to follow your progress and congrats on the launch!
By @firesteelrain - 6 months
Very Cool! We have made and built many PicoBalloons that have circumnavigated the globe. No weather reports - just WSPR reports. We can detect spots in the world where GPS spoofing is happening.

“ Each vehicle (balloon + payload) weighs less than a pound and can be launched from anywhere in the world, per the FAA and ICAO reg”

Florida recently passed a law that does not allow PicoBalloon or your weather balloon type launches from Florida soil. It will result in a $150 fine.

HB321

https://www.flsenate.gov/Session/Bill/2024/321/BillText/er/P...

Article

https://www.cbsnews.com/miami/news/floridas-balloon-ban-will...

By @simjnd - 6 months
> These conditions make the stratosphere a very difficult place to deploy to prod

This sentence is legendary

By @tagami - 6 months
For those interested, check out Bill Brown, the grandfather of lightweight modern ballooning. Multiple circumnavigations have been achieved with his equipment. https://www.stratoballooning.org/membership#!biz/id/5f4d7b97...
By @reachableceo - 6 months
Happy to discuss super pressure / float in depth.

Can help with the federal contract side and mass manufacturing etc.

Charles@turnsys.com

By @pagade - 6 months
To a layperson like me, could you explain how these balloons will be cleaned up / collected after their life? What material are they made up of?
By @aflukasz - 6 months
> In 1981, weather disasters caused $3.5 billion in damages in the United States. In 2023, that number was $94.9 billion (https://www.ncei.noaa.gov/access/billions/time-series).

Does that surprise someone? I think I would not have guessed this growth to be on such a scale. The chart suggests that severe storms are the main culprit.

By @OhMeadhbh - 6 months
Cool Stuff. Sounds like you're following your dreams and doing something that needs doing.

It would be very cool if you could do an open house for bay area geeks to come and just ooh and ahh at the gadgetry. Even a virtual open house would be cool. Something less than a full demo, and more focused on the story behind the gestation and launch of the project (and then a demo.)

By @dev2point0 - 6 months
This is awesome, how do you manage climbing and descending with a balloon. Are you compressing the gas on board or using thermals?
By @hubraumhugo - 6 months
Very cool to see more YC hard tech startups emerging [0]. These are the kind of moonshot projects I love to see getting funded (instead of just SaaS and AI).

[0] https://www.ycombinator.com/companies/industry/hard-tech

By @datageek_31 - 6 months
Since you are generating hundreds of terabytes of data every day, can we get some insight into what the data platform is being used here to handle such scale?
By @xd1936 - 6 months
Very cool, congrats on the launch. You're spending nearly all of your time in the stratosphere collecting data, but what correlation does that have to ground forecasts? Are your "AI models" that you're producing forecasting stratosphere conditions, or more than that?
By @gusgordon - 6 months
This is awesome, nice work! In case it's useful, I made a Python package for calculating solar irradiance at altitude: https://github.com/gusgordon/airmass

Takes into account lots of stuff (e.g. attenuation from air, ozone, and water vapor) with the goal of estimating solar power at any altitude/latitude/day/time.

By @araes - 6 months
Your product idea is cool, the actual sell-able data to me, from a data scientist perspective, that is actually actionable (corp words!), is nil. I can't even figure out what you actually collect.

Also, your website runs like a dog, and make me not want to find out. It runs like a dog displaying dots ... on a sphere. With like, four (4), other images of note. Seriously, talk to one of these WASM demo people, this is sad for a company that posts here. "Book a Demo" with somebody that can write WebGL. I booked and canceled an appointment on Thu (4) Aug (8) 22, 2024 8:00 on your incredibly vague G. Calendar signup. It's a 42 joke. Learn WebGL.

And while you're at it, stop making websites that write 1000x / $ and "Book a Demo" without even vaguely mentioning cost. Give me a $100,000, I'll give you a $100. This sounds like an excellent business from my perspective. How bout you hand me your bank account, and I'll hand you $100.

By @bnycum - 6 months
Awesome project. I currently work on flight data recorders. As you are aware, weather plays a big part in aviation. We do collect some weather information and it’s always one of the more exciting topics in the work we do. Understand a lot of the pain points with data and satellite communication. Sounds like something to keep my eye on.
By @justinl33 - 6 months
as someone who's worked on a project involving weather data for agriculture over developing regions, I can't explain how bad (sparse and inconsistent) the data is. Can I ask how you handled the regulatory aspect of launching from urban areas in SF? I can imagine the FAA would have given you some trouble?
By @petervandijck - 6 months
When they said "launch more often" I guess you took that advice to heart :) Congrats on the launch(es).
By @hyperific - 6 months
It seems to me there is a real application for wide area persistent surveillance (WAPS). This is a significant concern for civil liberties and WAPS is a largely controversial technology. To whom will this technology be licensed and what, if any, limitations will you impose on allowed payloads?
By @DoctorOetker - 6 months
Is there a reason weather balloons can't be designed to stay aloft for much longer? is it really impossible to miniaturize gas separators in weight to replenish the lighter fraction of molecules to compensate for the slow leakage?
By @voxelizer - 6 months
Wow! I am surprised it is even legan to launch those ballons from SF, specially that close to the airport. What is the regulation? Is it based on the size/weigth of the ballon?
By @pkhodiyar - 6 months
curious to know how you guys store and process the data and make meaningful inferences out of the data collected. Redshift? BigQuery? Datazip?
By @Prcmaker - 6 months
Nice one team, I like it. Anything a remote mech eng can help with? Not looking to be hired, but keen to help with something different.
By @thoop - 6 months
Very cool and very useful!

"Worldwide, most radiosonde observations are taken daily at 00Z and 12Z (6 a.m. and 6 p.m. EST)" - NOAA.gov

I know we get more weather data from other sources, but it seems insane that these 2 launch times per day (per balloon location) are what make up most of our current weather forecasting data.

You mentioned solar. Do you have the capability (or plans) to run these over night as well?

By @mbokinala - 6 months
Congrats on the launch! Seeing this reminded me of building and launching a high-altitude weather balloon with some buddies back in high school - one of the coolest projects I've gotten to work on.

If it's not proprietary, I'd love to know - how do you "steer" vertically between different wind layers to move in the direction you want to go?

Can't wait to see where you guys take this!

By @mrandish - 6 months
Very cool! Seems like you're leveraging some similar navigational ideas as Google X's Project Loon. Loon was such a good fundamental idea, just a little too soon and not the right use case or business model. Initially operating on a smaller scale and focusing on less power-hungry data acquisition vs high bandwidth two way comms seems like a much more viable plan.
By @ahaucnx - 6 months
Interesting. I have two questions:

1) What parameters are you measuring ? Did you think about also measuring gases?

2) What's your business model?

By @ramonyc - 6 months
Neat :) I'm involved in a few projects focused on vertical profiling in the coastal urban boundary layer.

I saw in a response you said the balloons will periodically return to sea level and ascend (which sounds like a fun design challenge by itself.) Will you be doing so near populated areas as well?

Good luck!

By @bobbob1921 - 6 months
Very cool and wishing you all the best of luck.

One question that came to mind, and this applies to all weather baloons not yours specifically, with the large number of weather balloons launched daily, how is it That more aren’t sucked into airplane engines causing potential disaster for the airplane? Thanks

By @zebomon - 6 months
This is awesome! Congratulations! It makes sense to me as a layperson that as more companies are doing more expensive things in the sky there would be greater value to high-precision weather insights. This seems like an exciting mission and well-timed business.
By @plopz - 6 months
For your gridded data, what file format are you using, grib, netcdf, zarr?
By @chasemgray - 6 months
This looks amazing. Super exciting to see how this project grows!
By @cstasuik - 6 months
Incredibly cool, thanks for sharing. Are you planning on hiring any time soon? Also, if you don't mind sharing, what designer/firm worked on your web and branding?
By @popctrl - 6 months
This sounds like super interesting and meaningful work. Are you hiring, or do you have any advice for your average software engineer on getting into this space?
By @lispisok - 6 months
If this works this is huge. It will improve everything from knowing the weather for your weekend hike to hurricane evacuation order lead time and area
By @h1fra - 6 months
Once in a while, a very interesting project that seems to be truly disrupting, congrats!
By @mnky9800n - 6 months
How many balloons do you have currently deployed? Do you have a data API for the balloons?
By @Faaak - 6 months
Check ou r2ho.me, I'm sure you could have great synergies for lowering price
By @tomnicholas1 - 6 months
So the equivalent of these balloons in oceanography are called ARGO floats, which similarly cannot be driven laterally but can control their own depth like a submarine. So far millions of timeseries have been collected across the world ocean using these floats.

https://argo.ucsd.edu/

One difference though is that the ARGO floats are unfortunately not recycled, and just wash up on various beaches. (I'm curious whether you think you can realistically collect many of these mini balloons?)

If you do want to control the lateral position of fleets of sensors, oceanographers also now have "gliders", which are basically small powered drone submarines. These are used by a few groups, but most of the gliders in the world are operated by the US Navy, who launch them out of torpedo tubes to survey local ocean conditions (which is badass).

https://oceanservice.noaa.gov/facts/ocean-gliders.html

The recorded measurements present an interesting data assimilation challenge - they record data along 3D trajectories (4D including time), sampling jagged and twisting lines through the 4D space. But we normally prefer to think of weather/ocean data as gridded, so you need to interpolate the trajectory data onto the grid, whilst keeping the result physically-consistent. Oceanographers use systems like ECCO for ocean state estimation, which effectively find the "ocean of best fit" to various data sources.

https://www.ecco-group.org/

Interestingly ECCO uses an auto-differentiable form of the governing equations for the ocean flow to ensure that updates stay physically consistent. This works by using a differentiable ocean fluid model called [MITgcm](https://github.com/MITgcm/MITgcm) to perform runs which match experimental data as closely as possible, and minimizing a loss function through gradient descent. The gradient is of a loss function (error) with respect to model input parameters + forcings, which is calculated by running MITgcm in adjoint mode - i.e. automatic differentation. Therefore this approach is sort of ML before it was cool (they were doing all this well before the new batch of AI weather models). See slides 9-18 of this deck for a nice explanation

https://firebasestorage.googleapis.com/v0/b/firescript-577a2...

The trajectory data is also interesting because it's sort of tabular, but also you often want to query it in an array-like 4D space. You could also call it a "ragged" array. We have nice open-source tools for gridded (non-ragged) arrays (e.g. xarray and zarr, and the pangeo.io project) but I think we could provide scientists with better tools for trajectory-like data in general. If that seems relevant to you I would love to chat.

P.S: Sorceror seems awesome, and I applaud you for working on something hard-tech & climate-tech!

By @lormayna - 6 months
As someone that is involved in catching radiosondes, this is quite cool!
By @kyrofa - 6 months
This is a great idea. I had no idea about the single-use radiosondes.
By @nilaymodi123 - 6 months
Congrats on launching. I love this idea. Makes so much sense haha
By @zuckerma - 6 months
This looks super cool
By @StanislavPetrov - 6 months
Sounds very cool.

Sorcerer was also an amazing Infocom game. Good company.

By @worldmerge - 6 months
This is incredibly cool!

Are you hiring? This is really exciting work.

By @underdeserver - 6 months
How did you come up with the name?
By @ptsd_dalmatian - 6 months
Very exciting, congrats on this! I’ve been watching numerous weather forecasts over the last couple of years because of my interests in mountain sports, and I am very very curious how will this improve forecast accuracy. Good luck worh everything.
By @supdudesupdude - 6 months
Cool stuff but i've never seen much come out of these kinds of things. Crowd sourced surface pressure application will bring in so many observations the forecasts will be improved 30%. Fuck no.

So you really think you can launch a giant network of balloons and have that data integrated into the NOAA/NCEP model suite? Even if you get over the red tape it will take 10 years + to integrate this shit into the data assimilation program. You claim that you can input your balloon data into magical AI and it produces better forecasts than what the GFS? What is the standard of measurement I dont actually believe you at all

By @nojvek - 6 months
YC money well spent instead of the next LLM app.
By @PaywallBuster - 6 months
flying condom /s

the idea sounds great tho!