Tweaks to WASM-based build for JVM #1

headius · 2026-01-22T01:32:05Z

This started out as just a bit of cleanup and documentation, but with help from @andreaTP it became a large update of how we use Chicory to run Prism.

The original cleanup items:

prism.org already exists and we don't own it, so moved Maven groupID to org.jruby.
As this is a chicory-based binding for prism, renamed artifact to chicory-prism.
Added JRuby dependency, as the only current consumer of chicory-prism is JRuby and the parser will usually reference RubySymbol.
Moved make target java-wasm build output to java-wasm/src/main/resources.
Added a README with basic instructions for bootstrapping and building the artifact.

After that, the functional updates:

update chicory to latest (1.6.1)
proper memory management for data entering and leaving the WASM engine
reduce allocation for buffers that can be used repeatedly
start preparing to publish a maven artifact

…ring Reject `def f a, (b) = 1`

See ruby/ruby@6d81969 It leaves the old variant around. RuboCop for examples accesses `Prism::Translation::Parser35` to test against ruby-head. For now I left these simply as an alias

While the latter creates an intermediate array of all method names including all ancestors, the former just traverse the inheritance chain and can stop if found once.

Update the 3.5 Gemfile

Use `method_defined?` instead of `instance_methods.include?`

Move gemfiles for 3.5 to 4.0

Bumps the java-deps group in /java-wasm with 3 updates: [com.dylibso.chicory:bom](https://github.com/dylibso/chicory), com.dylibso.chicory:annotations-processor and [com.dylibso.chicory:chicory-compiler-maven-plugin](https://github.com/dylibso/chicory). Updates `com.dylibso.chicory:bom` from 1.5.3 to 1.6.0 - [Release notes](https://github.com/dylibso/chicory/releases) - [Commits](dylibso/chicory@1.5.3...1.6.0) Updates `com.dylibso.chicory:annotations-processor` from 1.5.3 to 1.6.0 Updates `com.dylibso.chicory:chicory-compiler-maven-plugin` from 1.5.3 to 1.6.0 - [Release notes](https://github.com/dylibso/chicory/releases) - [Commits](dylibso/chicory@1.5.3...1.6.0) Updates `com.dylibso.chicory:annotations-processor` from 1.5.3 to 1.6.0 Updates `com.dylibso.chicory:chicory-compiler-maven-plugin` from 1.5.3 to 1.6.0 - [Release notes](https://github.com/dylibso/chicory/releases) - [Commits](dylibso/chicory@1.5.3...1.6.0) --- updated-dependencies: - dependency-name: com.dylibso.chicory:bom dependency-version: 1.6.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: java-deps - dependency-name: com.dylibso.chicory:annotations-processor dependency-version: 1.6.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: java-deps - dependency-name: com.dylibso.chicory:chicory-compiler-maven-plugin dependency-version: 1.6.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: java-deps - dependency-name: com.dylibso.chicory:annotations-processor dependency-version: 1.6.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: java-deps - dependency-name: com.dylibso.chicory:chicory-compiler-maven-plugin dependency-version: 1.6.0 dependency-type: direct:production update-type: version-update:semver-minor dependency-group: java-deps ... Signed-off-by: dependabot[bot] <support@github.com>

…a-deps-48b38cc957 Bump the java-deps group in /java-wasm with 3 updates

https://bugs.ruby-lang.org/issues/21645

`gemfiles/3.5/Gemfile` has been updated to `gemfiles/4.0/Gemfile` by ruby#3715.

Fixes [Bug #21661]

Reject endless method as a block parameter default

Reverse sync from upstream

Bump ruby deps for typecheck

Reenable windows CI that were disabled because of fiddle

When we know we are in an alternation, and we know we have captured variables, add a syntax error by visiting the pattern subtree and finding the local variable target nodes and adding an error.

Revisit variable capture syntax error

Remove now obsolete todos

Respect parse.y excludes in CI

Optimize ripper translator

…:Ripper * Handle line continuations. * Handle space at the end of file in LexCompat. Co-authored-by: Earlopain <14981592+Earlopain@users.noreply.github.com>

Add Ripper :on_sp events for Prism.lex_compat and Prism::Translation::Ripper

You're supposed to return the first argument. ```rb # Before [[:stmts_new], [:rescue_mod, nil, nil], [:stmts_add, nil, nil], [:program, nil]] # After [[:stmts_new], [:rescue_mod, "1", "2"], [:stmts_add, nil, "1"], [:program, nil]] ``` The correct result would be: `[[:rescue_mod, "1", "2"], [:stmts_new], [:stmts_add, nil, "1"], [:program, nil]]` But the order depends on the prism AST so it seems very difficult to match.

Fix `on_*` return value of ripper translator

… translator * We don't know what `on_*` events might return so we cannot assume it's an Array. * See ruby#3838 (comment)

We should touch these as little as possible and just pass them along

Add `license` identifier to Rust crates

…g-any Check using Prism nodes if a command call has any arguments in Ripper translator

org.jruby:chicory-prism

Nodes need access to RubySymbol and support APIs at least.

* It is a resource used as source code (in wasm) that is compiled for the project artifact. * Added to Rake CLOBBER

andreaTP · 2026-01-23T10:58:16Z

.github/workflows/java-wasm-bindings.yml

        with:
          name: prism.wasm
-          path: java-wasm/src/test/resources/prism.wasm
+          path: java-wasm/src/main/resources/prism.wasm


The prism.wasm file was very intentionally placed in test so that it doesn't get included in the resulting jar (it's redundant).

The Chicory compiler already generates a org/prism/PrismParser.meta file that is smaller and contains everything needed for execution.

andreaTP · 2026-01-23T10:59:10Z

java-wasm/src/main/java/org/prism/Prism.java

+        instance = Instance.builder(module)
            .withMemoryFactory(limits -> new ByteArrayMemory(new MemoryLimits(10, MemoryLimits.MAX_PAGES)))
-            .withMachineFactory(PrismModule::create)
+            .withMachineFactory(parser.machineFactory())


nit: .withMachineFactory(PrismParser::create)

andreaTP · 2026-01-23T11:14:50Z

java-wasm/src/main/java/org/prism/Prism.java

@@ -1,11 +1,12 @@
 package org.prism;


Not a big deal, but you might want to align the package name to the new groupId.

Yeah working on that now.

Allow the buffer functions to manage the internal pointer and use consistent argument order for calloc.

We need to free the current_block_exits in parse_program when we're done with it to prevent memory leaks. This fixes the following memory leak detected when running Ruby using `RUBY_FREE_AT_EXIT=1 ruby -nc -e "break"`: Direct leak of 32 byte(s) in 1 object(s) allocated from: #0 0x5bd3c5bc66c8 in realloc (miniruby+0x616c8) (BuildId: ba6a96e5a060aec6fd9f05ed7e95d9627e1dbd74) #1 0x5bd3c5f91fd9 in pm_node_list_grow prism/templates/src/node.c.erb:35:40 #2 0x5bd3c5f91e9d in pm_node_list_append prism/templates/src/node.c.erb:48:9 ruby#3 0x5bd3c6001fa0 in parse_block_exit prism/prism.c:15788:17 ruby#4 0x5bd3c5fee155 in parse_expression_prefix prism/prism.c:19221:50 ruby#5 0x5bd3c5fe9970 in parse_expression prism/prism.c:22235:23 ruby#6 0x5bd3c5fe0586 in parse_statements prism/prism.c:13976:27 ruby#7 0x5bd3c5fd6792 in parse_program prism/prism.c:22508:40

Primarily for testing purposes.

This is not all of the boot files but is sufficient to demonstrate a memory fault in the AOT WASM parser.

Fix the memory leak

Cleanup and improvements

kddnewton and others added 30 commits November 5, 2025 13:02

Merge pull request ruby#3706 from Earlopain/bin-prism-lex

a6f7e60

Merge pull request ruby#3700 from Earlopain/endless-command-destructu…

a156df0

…ring Reject `def f a, (b) = 1`

Reverse-sync ruby/ruby@f4e0178

54606b8

Rename Ruby 3.5 to Ruby 4.0

d0a823f

See ruby/ruby@6d81969 It leaves the old variant around. RuboCop for examples accesses `Prism::Translation::Parser35` to test against ruby-head. For now I left these simply as an alias

Merge pull request ruby#3709 from Earlopain/ruby-4.0

b3d83f6

Use method_defined? instead of instance_methods.include?

6da384d

While the latter creates an intermediate array of all method names including all ancestors, the former just traverse the inheritance chain and can stop if found once.

Update the 3.5 Gemfile

9480e55

Merge pull request ruby#3716 from ruby/update-3.5-gemfile

0bc452b

Update the 3.5 Gemfile

Merge pull request ruby#3714 from nobu/use-method_defined

a3850e7

Use `method_defined?` instead of `instance_methods.include?`

Move gemfiles for 3.5 to 4.0

21b94bc

Merge pull request ruby#3715 from nobu/gemfiles-4.0

d80f8a0

Move gemfiles for 3.5 to 4.0

Merge pull request ruby#3711 from ruby/dependabot/maven/java-wasm/jav…

21fe9d8

…a-deps-48b38cc957 Bump the java-deps group in /java-wasm with 3 updates

Bump Ruby deps

74ab72b

Reenable windows CI that were disabled because of fiddle

74d9b6b

https://bugs.ruby-lang.org/issues/21645

Bump ruby deps for typecheck

878cd29

Bump bin/prism bundle to Ruby 4.0

86120ae

`gemfiles/3.5/Gemfile` has been updated to `gemfiles/4.0/Gemfile` by ruby#3715.

Reject endless method as a block parameter default

475fa46

Fixes [Bug #21661]

Merge pull request ruby#3702 from Earlopain/endless-method-in-block-args

adf7412

Reject endless method as a block parameter default

Merge pull request ruby#3721 from koic/bump_bin_prism_bundle_to_ruby_4_0

63084bd

Reverse sync from upstream

87dffcf

Merge pull request ruby#3722 from ruby/reverse-sync

8956f1d

Reverse sync from upstream

Merge pull request ruby#3719 from ruby/bump-ruby-deps

abdea93

Bump ruby deps for typecheck

Merge pull request ruby#3687 from Earlopain/reenable-fiddle-failures

7a480cb

Reenable windows CI that were disabled because of fiddle

Revisit variable capture syntax error

c03e113

When we know we are in an alternation, and we know we have captured variables, add a syntax error by visiting the pattern subtree and finding the local variable target nodes and adding an error.

Merge pull request ruby#3723 from ruby/revisit-variable-capture

ee86818

Revisit variable capture syntax error

Respect parse.y excludes in CI

7ef5b42

Remove now obsolete todos

b00d098

Merge pull request ruby#3726 from Earlopain/resolv-todo

6a6843a

Remove now obsolete todos

Merge pull request ruby#3725 from Earlopain/respect-parse-y-excludes

16e5efb

Respect parse.y excludes in CI

eregon and others added 15 commits January 20, 2026 00:54

Merge pull request ruby#3862 from Earlopain/optimize-ripper

3e29586

Optimize ripper translator

Ignore *.rb at the root for rake typecheck:sorbet

df7b4e5

Add Ripper :on_sp events for Prism.lex_compat and Prism::Translation:…

32bd13e

…:Ripper * Handle line continuations. * Handle space at the end of file in LexCompat. Co-authored-by: Earlopain <14981592+Earlopain@users.noreply.github.com>

Merge pull request ruby#3859 from eregon/ripper_on_sp

38c64e5

Add Ripper :on_sp events for Prism.lex_compat and Prism::Translation::Ripper

Add license identifier to Rust crates

4deba7b

Merge pull request ruby#3865 from Earlopain/ripper-events-return-value

63719d8

Fix `on_*` return value of ripper translator

Check using Prism nodes if a command call has any arguments in Ripper…

bed4271

… translator * We don't know what `on_*` events might return so we cannot assume it's an Array. * See ruby#3838 (comment)

Also handle BasicObject as a return value

52c4fa7

We should touch these as little as possible and just pass them along

Merge pull request ruby#3866 from Shopify/vs_add_license_to_crates

1f00a20

Add `license` identifier to Rust crates

Merge pull request ruby#3867 from eregon/check-if-array-before-callin…

5ea83ca

…g-any Check using Prism nodes if a command call has any arguments in Ripper translator

Update group and artifact for publishing

e0af0ef

org.jruby:chicory-prism

Add JRuby dependency for building parser API

0d3a2f2

Nodes need access to RubySymbol and support APIs at least.

Move java_wasm output to src/main/resources

239e5ee

* It is a resource used as source code (in wasm) that is compiled for the project artifact. * Added to Rake CLOBBER

Add basic bootstrapping instructions

742872c

headius mentioned this pull request Jan 22, 2026

Integrate WASM-based Prism parser into standard build jruby/jruby#9184

Draft

Upgrade to chicory 1.6.1

70c40c1

andreaTP reviewed Jan 23, 2026

View reviewed changes

headius added 2 commits January 23, 2026 15:26

Merge remote-tracking branch 'ruby/main' into jruby-prism-wasm-updates

b1ec913

Simplify setup and teardown

098305d

Allow the buffer functions to manage the internal pointer and use consistent argument order for calloc.

headius and others added 7 commits January 26, 2026 12:31

Support AOT and interp WASM

1cbe798

Primarily for testing purposes.

Add test that parses JRuby's boot files

8e1aed5

This is not all of the boot files but is sufficient to demonstrate a memory fault in the AOT WASM parser.

Fix the memory leak

3236f86

rem string free

1e17c1b

Merge pull request #1 from andreaTP/fix-memory-leak

010d03b

Fix the memory leak

Cleanup and improvements

d05601c

Merge pull request #2 from andreaTP/more-cleanup

59b9326

Cleanup and improvements

headius merged commit ed09e78 into jruby:topic/javawasm_changes Feb 3, 2026
62 of 65 checks passed

headius deleted the jruby-prism-wasm-updates branch February 3, 2026 19:28

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Tweaks to WASM-based build for JVM #1

Tweaks to WASM-based build for JVM #1

headius commented Jan 22, 2026 •

edited

Loading

Uh oh!

andreaTP Jan 23, 2026

Uh oh!

andreaTP Jan 23, 2026

Uh oh!

andreaTP Jan 23, 2026

Uh oh!

headius Feb 3, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

17 participants

Tweaks to WASM-based build for JVM #1

Tweaks to WASM-based build for JVM #1

Conversation

headius commented Jan 22, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

andreaTP Jan 23, 2026

Choose a reason for hiding this comment

Uh oh!

andreaTP Jan 23, 2026

Choose a reason for hiding this comment

Uh oh!

andreaTP Jan 23, 2026

Choose a reason for hiding this comment

Uh oh!

headius Feb 3, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

17 participants

headius commented Jan 22, 2026 •

edited

Loading