101010.pl: About · Status · Profiles directory · Privacy policy
Mastodon: About · Get the app · Keyboard shortcuts · View source code · v4.4.0-alpha.4
3/
The end result? LLMs perform much worse on *symbolic* reasoning (screenshot), suggesting they leverage heavily on the semantics of the words involved rather than really understand and follow reasoning patterns.
2/
They use a symbolic dataset and a semantic dataset to test models’ abilities on memorization and reasoning (screenshot 1). For each dataset they created a corresponding one in the other modality, e.g., they replace natural language labels for the relations and the entities with abstract symbols to create a symbolic version of a semantic dataset (screenshot 2).
1/
When performing reasoning or generating code, do #LLMs really understand what they’re doing, or do they just memorize? Several new results seem to have painted a not-so-rosy picture.
The authors in [1] are interested in testing LLMs on “semantic” vs. “symbolic” reasoning: the former involves reasoning with language-like input, and the latter is reasoning with abstract symbols.
Now available in the #VisualStudioMarketplace #CodeFactory for #VisualStudio is a free open-source tool allowing users to author custom #DotNet #CodeGeneration commands.
https://marketplace.visualstudio.com/items?itemName=CodeFactoryLLC.CFRTVS2022
From #API specifications to code with OpenAPI: generating client and server source code.
Last 'piece' of the year diving into what I presented at #apidays Paris. The role of #OpenAPI, the power of #CodeGeneration, the way to manage SDKs and deliver valuable #DeveloperExperience.
https://medium.com/geekculture/from-api-specifications-to-code-with-openapi-76d13c12203b
Mostly, software interfaces are only defined by their signature and without a formal description of the admissible behavior and timing assumptions.
#ComMA provides a family of domain-specific languages that integrate existing techniques from formal behavioral and time modeling and is easily extensible.
#SoftwareEngineering
#Interfaces
#Modelling
#ModelChecking
#CodeGeneration
RT @pEpFoundation@twitter.com
@vecirex@twitter.com Jobs, Jobs, Jobs: Now!
We happily employ someone who has knowledge about formal languages / compilers and wants to engage in #codegeneration!
Check out #KeySync files, finally generated into C99 code using #YML2: https://pep.foundation/dev/repos/pEpEngine/file/tip/sync
Thought about having #cabal run under #qmake for having some #Haskell in a C project, but I will probably just do some C #codegeneration in Perl
Mastodon is the best way to keep up with what's happening.
Follow anyone across the fediverse and see it all in chronological order. No algorithms, ads, or clickbait in sight.
Create accountLogin