feat(api): add Shiki syntax highlighting support for UCD files#523
Closed
feat(api): add Shiki syntax highlighting support for UCD files#523
Conversation
- Added caching functionality with `tryLoadCachedResult`, `buildCacheKey`, and `storeCacheEntry` to optimize pipeline execution. - Introduced event handling through `createEventEmitter` and `emitWithSpan` for better tracking of pipeline events. - Implemented a processing queue with `createProcessingQueue` to manage concurrent task execution. - Enhanced route processing with `processRoute` and `processFallback` to handle file parsing and artifact emission. - Updated source adapter functionality for file reading and context creation. This update improves performance and maintainability of the pipeline executor by introducing structured caching and event management.
…graph - Implement tests for pipeline artifacts to ensure global artifacts are built before execution. - Add tests for executor cache behavior, verifying cache events are emitted correctly. - Create tests for executor events to confirm pipeline and version events are emitted. - Introduce tests for graph structure, ensuring edges are built across multiple routes. - Refactor helper functions for better test organization and reusability.
- Introduced `execution-logs.ts` for handling execution spans and formatting timestamps, durations, and bytes. - Added `format-time.ts` for high precision time formatting. - Created `pipeline-utils.ts` for converting pipeline definitions to structured info and details. - Implemented layout logic in `layout.ts` for positioning nodes in the pipeline graph. - Updated `index.ts` to export new utilities and types. - Added global styles in `globals.css` and defined types in `types.ts`. - Configured TypeScript and build settings with `tsconfig.json` and `tsdown.config.ts`. - Updated dependencies in `pnpm-lock.yaml` and `pnpm-workspace.yaml` for new packages.
- Introduced `standard.ts` and `unicode-data.ts` for parsing Unicode data. - Created basic, emoji, and full pipelines to process Unicode Character Database files. - Implemented grouped and property JSON resolvers for structured data handling. - Added HTTP and memory sources for file retrieval. - Included various transforms for data manipulation, such as deduplication and range expansion.
- Updated `turbo` from `2.8.3` to `2.8.6` - Updated `openapi-typescript` from `7.10.1` to `7.13.0` - Updated `rolldown` from `1.0.0-rc.3` to `1.0.0-rc.4` - Updated `@vitejs/plugin-react` from `5.1.3` to `5.1.4` - Updated `@cloudflare/vite-plugin` from `1.23.1` to `1.24.0` - Updated `@tanstack/router-plugin` from `1.158.4` to `1.159.5` - Updated `drizzle-kit` from `0.31.8` to `0.31.9` - Updated `esrap` from `2.2.2` to `2.2.3` - Updated `msw` from `2.12.9` to `2.12.10` - Updated `@luxass/eslint-config` from `7.0.1` to `7.1.0` - Updated `@typescript-eslint/utils` from `8.54.0` to `8.55.0` - Updated `@eslint-react/eslint-plugin` from `2.12.2` to `2.12.4` - Updated `ai` from `6.0.77` to `6.0.79` - Updated `wrangler` from `4.63.0` to `4.64.0` - Updated `@cloudflare/workers-types` from `4.20260207.0` to `4.20260210.0` - Updated `h3` from `2.0.1-rc.11` to `2.0.1-rc.14` - Updated `@types/react` from `19.2.13` to `19.2.14` - Updated `@tanstack/react-router` and related packages to `1.159.5` - Updated `fumadocs-core` and `fumadocs-ui` to `16.5.4` - Updated `packageManager` in `moonbeam`, `tsconfig`, and `vscode` to `pnpm@10.29.3`
Updated `turbo` to version 2.8.7, `nanotar` to 0.2.1, `vite-tsconfig-paths` to 6.1.1, and `@luxass/eslint-config` to 7.2.0 in the `pnpm-workspace.yaml` file. These updates include minor improvements and bug fixes.
- Moved `NON_RENDERABLE_EXTENSIONS` and `getFileTypeDescription` to a new `lib/file-explorer.ts` file for better organization. - Updated imports in relevant components to use the new utility functions. - Improved code readability and maintainability by consolidating related logic.
- Introduced `createMemoryBackend` and `createMemorySource` for in-memory data handling. - Implemented deduplication and range expansion transforms with `createDeduplicateTransform` and `createExpandRangesTransform`. - Added normalization and sorting transforms with `createNormalizeTransform` and `createSortTransform`. - Enhanced utility functions for array manipulation and parsing. - Updated pipeline presets to utilize new sources and transforms.
Updated the `@ucdjs/release-scripts` package version from `0.1.0-beta.24` to `0.1.0-beta.25` in both `pnpm-lock.yaml` and `pnpm-workspace.yaml` to ensure consistency across the project.
feat: improve frontend homepage
- Implemented `lockfile` and `snapshot` routes to handle versioned data retrieval. - Added tests for both routes to ensure correct functionality and error handling. - Introduced utility functions for path transformations in `path-utils`.
…/ucd/` occurrences
- Added a search form to the sidebar for quick navigation. - Integrated `ThemeToggle` component for theme switching. - Improved sidebar header layout for better responsiveness.
- Added new routes for the file explorer under the `(explorer)` scope. - Created `DirectoryExplorerPage` and `FileViewerPage` components to handle directory and file viewing. - Integrated search functionality and loading states for file exploration. - Implemented skeleton loading for better user experience during data fetching.
- Introduced new route for syntax highlighting of UCD files using Shiki. - Added eligibility checks for file types and sizes. - Implemented error handling for unsupported media types and payload size limits. - Updated `package.json` and lock files to include `shiki` and `shiki-stream` dependencies.
Contributor
|
Important Review skippedDraft detected. Please check the settings in the CodeRabbit UI or the You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Contributor
🌏 Preview Deployments
Built from commit: 🤖 This comment will be updated automatically when you push new commits to this PR. |
Contributor
📋 OpenAPI Schema AnalysisSummaryAPI Endpoints
Overall Status
Detailed Changes🟢 Added Endpoints (1)
🤖 This comment is automatically updated when you push new commits. |
Codecov Report❌ Patch coverage is
📢 Thoughts on this report? Let us know! |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
package.jsonand lock files to includeshikiandshiki-streamdependencies.🔗 Linked issue
📚 Description