Commit Graph

803 Commits

Author SHA1 Message Date
zoecarver
2e1893fe53 [astgen] Fix tuple locations. 2022-11-01 09:32:41 -07:00
zoecarver
42f4b750a9 [astgen] Add '.rawValue' to map operation. 2022-11-01 09:32:41 -07:00
Zoe Carver
60c8b4b178 Merge pull request #61834 from zoecarver/astgen-array-literal 2022-11-01 07:49:28 -07:00
swift-ci
90cc923acc Merge pull request #61829 from zoecarver/astgen-post-commit-review
[astgen] Address comments post-commit.
2022-10-31 16:33:42 -07:00
zoecarver
0801d478b8 [astgen] Add support for ArrayExpr. 2022-10-31 15:20:10 -07:00
Richard Wei
4ce1ebb120 [Macros] Support user-defined macros as compiler plugins (#61734)
Allow user-defined macros to be loaded from dynamic libraries and evaluated.

- Introduce a _CompilerPluginSupport module installed into the toolchain. Its `_CompilerPlugin` protocol acts as a stable interface between the compiler and user-defined macros.
- Introduce a `-load-plugin-library <path>` attribute which allows users to specify dynamic libraries to be loaded into the compiler.

A macro library must declare a public top-level computed property `public var allMacros: [Any.Type]` and be compiled to a dynamic library. The compiler will call the getter of this property to obtain and register all macros.

Known issues:
- We current do not have a way to strip out unnecessary symbols from the plugin dylib, i.e. produce a plugin library that does not contain SwiftSyntax symbols that will collide with the compiler itself.
- `MacroExpansionExpr`'s type is hard-coded as `(Int, String)`. It should instead be specified by the macro via protocol requirements such as `signature` and `genericSignature`. We need more protocol requirements in `_CompilerPlugin` to handle this.
- `dlopen` is not secure and is only for prototyping use here.

Friend PR: apple/swift-syntax#1022
2022-10-31 14:03:25 -07:00
zoecarver
88dfb83d76 Address a comments post-commit. 2022-10-31 13:51:14 -07:00
zoecarver
dd4a0ec405 [nfc] Format changes. 2022-10-30 12:01:31 -07:00
zoecarver
f85d687278 [astgen] Correctly thread initializer through VarDecl visitor. 2022-10-30 12:00:58 -07:00
zoecarver
37ef2d7834 [astgen] Correctly thread 'name' through VarDecl visitor. 2022-10-30 11:50:15 -07:00
zoecarver
799463b81e [astgen] Add ASTNodeKind; support decls in code-blocks. 2022-10-30 11:42:55 -07:00
zoecarver
3447dd7baa [astgen] Set TypeRepr when visiting ParamDecls. 2022-10-30 11:32:02 -07:00
zoecarver
6855ca76a0 [astgen] Add begin and end source locs to BraceStmt visitor. 2022-10-30 11:20:53 -07:00
zoecarver
61b160d288 [nfc] Run swift-format over Swift ASTGen sources. 2022-10-30 11:03:53 -07:00
zoecarver
371eb9143d [astgen] Add ReturnStmt visitor. 2022-10-30 10:55:17 -07:00
zoecarver
bec4ff77f3 [astgen] Use ASTNode to implement BraceStmt correctly. 2022-10-30 10:50:13 -07:00
zoecarver
6b7123e1e9 [astgen] Introduce ASTNode; update ResultType to be ASTNode. 2022-10-30 10:50:03 -07:00
Doug Gregor
8461427ef4 [ASTGen] Fix off-by-one error in allocation of UTF-8 string for buffer use
The semantics of llvm::MemoryBuffer and NULL termination are... subtle.
2022-10-27 17:05:20 -07:00
Robert Widmann
822fd47b8a Add Utilities to Retrieve the (Opened) Type of a Macro Reference 2022-10-27 11:11:11 -07:00
Robert Widmann
032e8d5e1d Start Lowering Generic ASTs
Lower generic argument lists and generic parameter lists, then expand the lowering for identifiers to take generic arguments into account.
2022-10-27 11:11:11 -07:00
Robert Widmann
f4f7f7f2ce Finish Off ASTGen Implementation for Types
Complete the lowering for the type ASTs present in SwiftSyntax to C++ TypeReprs
2022-10-27 11:11:11 -07:00
Doug Gregor
6cd0327655 Merge pull request #61691 from DougGregor/macros-expand-and-type-check 2022-10-24 05:47:57 -07:00
Doug Gregor
f04fd94465 [Macros] Separate out the expansion of macros into its own source file.
Once we've expanded a macro, create a new source buffer containing
the expanded macro contents.
2022-10-23 14:53:11 -07:00
Alex Hoppen
0738413fb7 [CMake] Link swiftParse and swiftAST against SwiftParserDiagnostics 2022-10-23 23:34:13 +02:00
Doug Gregor
e2993ea9bf [ASTGen] Support older host compilers 2022-10-21 06:41:06 -07:00
Doug Gregor
9979bb0e0a [Macros] Pass evaluated macro source back into the C++ part of the compiler.
Use this to print out the rewritten macro, for now.
2022-10-21 06:41:06 -07:00
Doug Gregor
636e6d1524 [Macros] "Expand" builtin macros for magic literals.
Introduce an experimental option `BuiltinMacros` that takes the magic
literals (`#file`, `#line`, `#function`, etc.) after type checking and
processes the original source for the expression using the build
syntactic macro system in the swift-syntax library. At present, the
result of expansion is printed to standard output, but it's enough to
verify that we're able to find the corresponding syntax node based on
the C++ AST.
2022-10-21 06:41:05 -07:00
Doug Gregor
9c528c6fe2 [ASTGen] Link in syntactic macros 2022-10-21 06:39:53 -07:00
Doug Gregor
2b741ad376 Move ASTGen source-file handling to its own (Swift) file 2022-10-21 06:39:53 -07:00
Doug Gregor
d33998538c Hold on to the SwiftSyntax source file parsed by ASTGen.
Rework the ASTGen interface to split apart parsing a source file,
turning the top-level declarations from that source file into C++ AST
nodes, and then deallocating that source file. Hold on to the source
file in the C++ SourceFile abstraction so we can query it later if we
need to.

And we will need to.
2022-10-21 06:39:53 -07:00
Doug Gregor
dec8813797 Merge pull request #61538 from DougGregor/astgen-spurious-whitespace
[ASTGen] Remove spurious whitespace
2022-10-12 15:42:59 -07:00
Doug Gregor
46703efe57 [ASTGen] Remove spurious whitespace 2022-10-10 16:42:13 -07:00
Doug Gregor
e35e82e7fd Add more missing dependencies 2022-10-10 14:33:38 -07:00
Doug Gregor
aed4f74f3f [ASTGen] Set the target triple for swiftASTGen.
Builds of Swift sources via CMake are not getting a target triple set,
so they pick up the host triple. This leads to spurious warnings about
linking in code built for a newer OS version (e.g., the one you're on)
into libraries with an older deployment target. It also breaks
building a cross-compiler. Always set the target triple.
2022-10-07 21:49:34 -07:00
Doug Gregor
7fd7e4fba5 [CMake Export swiftASTGen so the LLDB target can use it 2022-10-07 16:01:44 -07:00
Doug Gregor
5a0d775fa5 [ASTGen] Add a comment about the purporse of its Package.swift 2022-10-07 10:19:06 -07:00
Doug Gregor
c95b6c40c9 [ASTGen] Fix integer and string literal mapping 2022-10-07 10:19:06 -07:00
Doug Gregor
f516223c60 [ASTGen] Do a little property-wrapper dance to move DeclContext into the visitor 2022-10-07 10:19:06 -07:00
Doug Gregor
8d7f4dfdef Remove xcworkspacedata and UserInterfaceState.xcuserstate 2022-10-07 10:19:06 -07:00
Doug Gregor
d4e7371ac4 [ASTGen] Make sure we spin the C++ parser even when we don't use it.
This is a temporary hack; we shouldn't even need to create the C++
parser here.
2022-10-07 10:19:06 -07:00
Doug Gregor
2f61489543 Don't try to bridge diagnostics from C++ to Swift
We'll be going the other way, with diagnostics existentials.
2022-10-07 10:19:06 -07:00
Doug Gregor
7483373326 [ASTGen] Use UTF-8 rather than C char, and use BridgedIdentifier consistently 2022-10-07 10:19:06 -07:00
Doug Gregor
54bcb33ee9 [CMake] Make sure swiftASTGen links swiftAST. 2022-10-07 10:19:06 -07:00
Doug Gregor
39f54bc1b4 Use add_library for Swift ASTGen library 2022-10-07 10:19:06 -07:00
Doug Gregor
8e6628616d Fix the package that builds swiftASTGen. 2022-10-07 10:19:06 -07:00
Doug Gregor
4da85ea091 Clean up build logic for ASTGen library.
Only introduce it and its dependency when the new Swift parser is being
built, and rely more on existing logic to make sure we get the right
build/link flags.
2022-10-07 10:19:05 -07:00
zoecarver
73fe41373b Support functions with statements in their body.
(cherry picked from commit 5935670931)
2022-10-07 10:19:05 -07:00
zoecarver
93f1505e8a Add support for bool literals.
(cherry picked from commit d58a01db95)
2022-10-07 10:19:05 -07:00
zoecarver
94f890d6c7 [nfc] Split ASTGen into files + extensions.
(cherry picked from commit 629fb688f0)
2022-10-07 10:19:05 -07:00
zoecarver
f7d501d770 Add support for structs/classes.
(cherry picked from commit 1b1944ea48)
2022-10-07 10:19:05 -07:00