v0.2.0

Installation and Dependencies

pip install ai-edge-torch==0.2.0

• Python versions: 3.9, 3.10, 3.11
• Operating system: Linux
• PyTorch: 2.4.0
• TensorFlow: tf-nightly>=2.18.0.dev20240722

See this section of the README

PyTorch Converter

Compatible with torch 2.4.0 stable release. pip install ai-edge-torch(-nightly) is now the only command needed to install ai-edge-torch and all dependencies.

Features

• Added ai_edge_torch.to_channel_last_io API (doc)
• Added ai_edge_torch.debug._search_model API

Performance Improvements

• Improved layout optimization algorithm and general model performance
• Improved performance for torch.nn.function.interpolate with nearest mode
• Improved performance for aten.gelu
• Improved performance for aten.avg_pool2d with ceil_mode=True
• Reduced conversion memory usage in torch_xla and MLIR converter

Bug Fix

• Fixed numerical/precision issue with aten.native_group_norm (nn.GroupNorm)

Generative API

Authoring API

• Implemented new layer components for diffusion-based models

Support for new models

• Stable Diffusion 1.5 support CPU

Quantization

• Enabled selective quantization for different Generative layers for LLMs
• Enabled weight-only quantization with computation in floating point for increased accuracy
• Added quantization support for embedding tables

Documentation

• Added system architecture overview for Torch generative API