Xcode used the open source GCC for years, until Apple replaced it with LLVM (which is also open source).
When I did jailbreak tweak development my build environment was all command line terminal tools, and it was fine.
In some ways better than Xcode is even now, in terms of debugging and inspection tools available.