Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

✨ feat: VQGrad, VQGradSeq #107

Merged
merged 14 commits into from
Sep 18, 2023
Merged

✨ feat: VQGrad, VQGradSeq #107

Changes from all commits
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
3c57c40
Rename reduce -> reduceSum.
jean-francoisreboud Sep 2, 2023
83f5c94
reduceMax
jean-francoisreboud Sep 2, 2023
a58ef45
VQGrad2D CPU.
jean-francoisreboud Sep 3, 2023
7f46e64
vqGradNorm metal kernels.
jean-francoisreboud Sep 3, 2023
1c1aabb
VQGradNorm2D GPU.
jean-francoisreboud Sep 3, 2023
87c697e
VQGradNormSeq CPU.
jean-francoisreboud Sep 3, 2023
3fb8804
VQGradNormSeq GPU.
jean-francoisreboud Sep 3, 2023
8bdf795
Update vqSeqBackward and vqSeqLoss.
jean-francoisreboud Sep 3, 2023
72b2b02
VQGradNorm2DTests init.
jean-francoisreboud Sep 3, 2023
a2287f2
VQGrad2DTests.testInference.
jean-francoisreboud Sep 4, 2023
a4291a6
VQGradSeqTests
jean-francoisreboud Sep 4, 2023
afe3e2f
minor
jean-francoisreboud Sep 4, 2023
ea13813
Update coeffs.
jean-francoisreboud Sep 6, 2023
0e56876
Update changelog.
jean-francoisreboud Sep 14, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions CHANGELOG.md
View file
Original file line number Diff line number Diff line change
@@ -4,6 +4,8 @@ All notable changes to this project will be documented in this file.

## [unreleased]

🪜 **feat:** VQGrad, VQGradSeq ([#107](https://github.com/owkin/GrAIdient/pull/107))

## 0.3.1 (2023-08-09)

### Bug Fixes
2 changes: 1 addition & 1 deletion Sources/GrAITestsUtils/Trainer.swift
View file
Original file line number Diff line number Diff line change
@@ -69,7 +69,7 @@ extension TestError: CustomStringConvertible
///
/// - Parameter model: The model on which to select the initialization scheme.
///
func randomSelectWeightsInitializationScheme(model: Model)
public func randomSelectWeightsInitializationScheme(model: Model)
{
let choice = Int.random(in: 0...4)
switch choice {
4 changes: 2 additions & 2 deletions Sources/GrAIdient/Layer2D/Normalize2D.swift
View file
Original file line number Diff line number Diff line change
@@ -570,7 +570,7 @@ public class Normalize122D: Layer2D
command.enqueue()

// Continue the reduction in a more generic way.
reduce(
reduceSum(
inBuffer: _squaredNorm.metal,
outBuffer: _squaredNorm.metal,
dim1: nbThreadgroups, dim2: batchSize,
@@ -725,7 +725,7 @@ public class Normalize122D: Layer2D
command.enqueue()

// Continue the reduction in a more generic way.
reduce(
reduceSum(
inBuffer: _deltaTmp.metal,
outBuffer: _deltaTmp.metal,
dim1: nbThreadgroups, dim2: batchSize,
Loading