I have a multiline file that I’ve loaded into a string using String(contentsOfFile:encoding:)
I'm trying to split the string using “someString.components(separatedBy: "==========\n“)
But it... just doesn’t. I know that particular string does exist in the file multiple times.
If I change the separator to just a linefeed it does split the file into 1600 items just fine. So for some reason it's not finding the "==========\n“ ?
If I read the file as .utf8, AND strip out the UTF16 BOM, BINGO.
let cleanedClippings = clippings.replacingOccurrences(of: "\u{feff}", with: "”)
Each entry has a UTF16 marke? who knows. 332 of them in my file! I grabbed it off my kindle again just to see if I had somehow done it, but no that's how it is.
@pixel@GeekAndDad@krzyzanowskim It looks like each individual clipping was originally a separate text file in utf-16 (which you would expect would start with a BOM), but then whatever did the combining wasn't aware and did either raw binary concatenation or expected utf-8 or some other encoding like that.
ok, thanks to both of you for digging into this. has to be something with my system. Even trying to just load the file and do components:separatedBy on it gives me the same issue. I'll have to look into this more later.
@GeekAndDad ok, that's not it. tried a few others and they didn't work. opened in BBEdit and resaved as UTF8 just to make sure that's what it is, and still get the error. WEIRD.
@GeekAndDad it's definitely the same character - I thought the same thing so I copied it straight from the file. There's no other invisible characters (turned on invisible chars in BBEdit).
Can't escape it like that, compiler yells (as it should)
its so weird.
fun new clue: changing the separator to just “=" crashes with the error "Swift/ContiguousArrayBuffer.swift:600: Fatal error: Index out of range”
Also, this is Swift running as a command line script (i.e. with hash bang on first line)
it's /r/n. I guess BBEdit shows the same character for /r/n and just /n EXCEPT if I do ""=\r\n" it crashes with the "Swift/ContiguousArrayBuffer.swift:600: Fatal error: Index out of range” error
@pixel Using your test file gist pasted into BBEdit doc works for me.
let s = try String(contentsOfFile: "/Users/dad/Downloads/testfile.txt",
encoding: .utf8)
let lines = s.components(separatedBy: "=\n")
print( "\(lines.count)")
Add comment