Skip to content

Emit custom character classes like an alternation #590

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 27 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
3b6b676
Copy over new ascii bitset
rctcwyvrn Jul 5, 2022
33caa79
Add matchBuiltin
rctcwyvrn Jul 5, 2022
139daa5
Remove debug prints
rctcwyvrn Jul 5, 2022
9abf4af
Remove bitset fast path
rctcwyvrn Jul 5, 2022
286f5d8
Fully remove remnants of the bitset fast path
rctcwyvrn Jul 6, 2022
9e915cd
Merge branch 'main' into speedy-builtins
rctcwyvrn Jul 7, 2022
e593ddb
Completely replace AssertionFunction with regexAssert(by:)
rctcwyvrn Jul 11, 2022
25dc277
Merge branch 'main' into speedy-builtins
rctcwyvrn Jul 12, 2022
3e38ac6
Cleanup
rctcwyvrn Jul 12, 2022
e5d8b4a
Move match builtin and assert + Add AssertionPayload
rctcwyvrn Jul 12, 2022
0466c25
Cleanup assertions
rctcwyvrn Jul 12, 2022
87078ad
Merge branch 'main' into speedy-builtins
rctcwyvrn Jul 12, 2022
f401e84
Fix tests
rctcwyvrn Jul 13, 2022
b09f45f
Update opcode description for assertBy
rctcwyvrn Jul 13, 2022
c581ea2
Merge branch 'main' into speedy-builtins
rctcwyvrn Jul 14, 2022
2a82231
Merge branch 'main' into speedy-builtins
rctcwyvrn Jul 15, 2022
fb1576a
Update branch to match main
rctcwyvrn Jul 15, 2022
3b9485e
Use the newly cleaned up _CharacterClassModel
rctcwyvrn Jul 16, 2022
64d1ed9
Add characterClass DSLTree node
rctcwyvrn Jul 16, 2022
2a6fe3c
Bugfixes
rctcwyvrn Jul 19, 2022
206bfc6
Add documentation for matchBuiltin
rctcwyvrn Jul 21, 2022
b53f524
Lots of cleanup
rctcwyvrn Jul 25, 2022
bb5245f
Move assertion payload
rctcwyvrn Jul 25, 2022
0746847
More minor cleanup
rctcwyvrn Jul 25, 2022
c718543
Perform boundary check for .anyScalar when in grapheme mode
rctcwyvrn Jul 25, 2022
3f0ece5
Emit custom character classes via saves and branches
rctcwyvrn Jul 25, 2022
79aabab
Add some comments
rctcwyvrn Jul 26, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
34 changes: 23 additions & 11 deletions Sources/RegexBuilder/CharacterClass.swift
Original file line number Diff line number Diff line change
Expand Up @@ -15,27 +15,39 @@
@available(SwiftStdlib 5.7, *)
public struct CharacterClass {
internal var ccc: DSLTree.CustomCharacterClass
/// The builtin character class, if this CharacterClass is representable by one
internal var builtin: DSLTree.Atom.CharacterClass?

init(_ ccc: DSLTree.CustomCharacterClass) {
self.ccc = ccc
self.builtin = nil
}

init(unconverted atom: DSLTree._AST.Atom) {
self.ccc = .init(members: [.atom(.unconverted(atom))])
init(builtin: DSLTree.Atom.CharacterClass) {
self.ccc = .init(members: [.atom(.characterClass(builtin))])
self.builtin = builtin
}
}

@available(SwiftStdlib 5.7, *)
extension CharacterClass: RegexComponent {
public var regex: Regex<Substring> {
_RegexFactory().customCharacterClass(ccc)
if let cc = builtin {
return _RegexFactory().characterClass(cc)
} else {
return _RegexFactory().customCharacterClass(ccc)
}
}
}

@available(SwiftStdlib 5.7, *)
extension CharacterClass {
public var inverted: CharacterClass {
CharacterClass(ccc.inverted)
if let inv = builtin?.inverted {
return CharacterClass(builtin: inv)
} else {
return CharacterClass(ccc.inverted)
}
}
}

Expand All @@ -50,15 +62,15 @@ extension RegexComponent where Self == CharacterClass {
}

public static var anyGraphemeCluster: CharacterClass {
.init(unconverted: ._anyGrapheme)
.init(builtin: .anyGrapheme)
}

public static var whitespace: CharacterClass {
.init(unconverted: ._whitespace)
.init(builtin: .whitespace)
}

public static var digit: CharacterClass {
.init(unconverted: ._digit)
.init(builtin: .digit)
}

public static var hexDigit: CharacterClass {
Expand All @@ -70,19 +82,19 @@ extension RegexComponent where Self == CharacterClass {
}

public static var horizontalWhitespace: CharacterClass {
.init(unconverted: ._horizontalWhitespace)
.init(builtin: .horizontalWhitespace)
}

public static var newlineSequence: CharacterClass {
.init(unconverted: ._newlineSequence)
.init(builtin: .newlineSequence)
}

public static var verticalWhitespace: CharacterClass {
.init(unconverted: ._verticalWhitespace)
.init(builtin: .verticalWhitespace)
}

public static var word: CharacterClass {
.init(unconverted: ._word)
.init(builtin: .word)
}
}

Expand Down
Loading