Improve JIT memory consumption by invalidating cold executors

[savannahostrowski]

We can try to improve JIT memory utilization by periodically freeing/invalidating infrequently run executors. This should improve memory usage in long-running programs.

Related to #116017

Linked PRs

• GH-123516: Improve JIT memory consumption by invalidating cold executors #123402
• GH-123516: Improve JIT memory consumption by invalidating cold executors #124443

[savannahostrowski]

Since #124443 was merged, this can be closed as completed!