Closing panel: does anything actually solve the frame problem?

Workshop: Framing the Problem

Setting up the problem

The starting frustration, voiced early on: we have decent normative accounts of what an ideal resource-rational agent would do, and some sense of what it means to reason "locally" and coherently, but there's remarkably little process-level story for what actually happens in between. One speaker put it as a bird's-eye view with no ground truth. We can describe the objective a resource-rational system should be pursuing, but not the mechanism that gets it there moment to moment.

Have language models already solved it?

One person staked out a deliberately provocative position: modern language models have, in effect, already solved the frame problem. They reliably act coherently despite facing an astronomically large space of things they could attend to, and we simply don't have a satisfying account of how. Maybe we never will, beyond "learning objectives and inscrutable linear algebra goo," a phrase that got repeated approvingly by a couple of other people in the room.

Pushback came quickly. Maybe language models are solving a differently shaped problem than the one humans actually face. Predicting the next token over a massive, general training distribution isn't obviously the same task as acting efficiently in a physical and social world with real stakes and real time pressure. If the constraints are different, a model's fluent output doesn't necessarily tell you the human-relevant version of the problem has been cracked. It might just mean a related, more tractable problem has been.

Two ways a model's success could be real

Someone offered a useful distinction. A model's apparent solution to framing could be trivial, brute-force pattern-matching over enough data that it just doesn't fail visibly anymore, or it could be structurally real, meaning the model ends up doing something with relatively few effective computational steps that functions similarly to how a person actually frames a problem. Nobody in the room seemed to think this was resolved either way.

Normative models versus process models

A recurring back-and-forth: is it useful to build normative models that explicitly minimize some objective (reward, or reward minus the cost of computation) under a hard resource constraint, like a fixed working-memory capacity? Or should the field lean more on bottom-up, associative process accounts that don't look like optimization at all? One view offered was that these aren't as separable as they sound. A well-specified resource-rational objective actually can be optimized subject to something like a hard working-memory constraint, and that constraint itself becomes a testable psychological claim rather than just a modeling convenience.

Is representation even separable from search?

A good chunk of the discussion circled around whether "framing" (picking or building a representation) and "solving" (searching it) are two different steps at all, or whether they're really the same thing happening repeatedly. One person put this sharply: planning is just framing, over and over again. Rather than committing to one fixed representation and searching it exhaustively, an agent is constantly re-deciding what's relevant just for the next few steps.

We may not have introspective access to any of this

Several people raised the same worry from different angles. Whatever process actually picks a frame or representation may be mostly invisible to conscious introspection, closer to the insight/aha-moment literature, where people reliably can't report what led up to a sudden shift in how they were seeing a problem.

Someone mentioned attempts to find speech or behavioral markers that predict an approaching insight before it happens. The honest answer, from that line of work, is that it's really hard. Either the precursor signals are extremely subtle, or whatever's happening beforehand isn't the kind of thing that shows up in language at all.

Costs, and getting the costs for free

Late in the discussion, someone brought the conversation back to resource-rational language directly. The value of a representation is its task utility minus the cost of building or computing it. But people clearly don't pay that cost from scratch every time, they reuse previously learned, "good" representations and heuristics. Some of that reuse is cultural, a chess opening you didn't invent yourself but inherited, and some of it is literally built into the environment, a calendar, a watch. Part of the frame problem, in other words, gets pushed outside the head entirely, into culture and designed tools.

Open questions, raised but not settled

The workshop organizers closed by thanking all the speakers and panelists, noting that a lot of what got raised here would be written up in an accompanying proceedings volume.