Scripting Interactions Only Gets You So Far