People keep telling me that #ChatGPT is amazing for proofreading text and improving scientific writing.
I just gave #GPT4 a section of a grant proposal and it made 11 suggestions, none of which were worth keeping (often adding or removing a comma, or repeating a preposition in a list).
More interestedly, a number of its suggestions were identical to my originals.
@ct_bergstrom for all the AI hype have they distinguished the difference between #automatiom and #intelligence? Automation requires significant processing capacity. Intelligence?
@ct_bergstrom Yea I asked it to rewrite one of my blog posts and it was at the level of a 15 year old school student or your average tabloid journalist.
@ct_bergstrom I've experienced the same situation. More, it sometimes wants me to correct something right, pushing me to make mistakes.
While I think it can be useful, people should stop using it like the oracle of delphi. It's a convincing liar.
@ct_bergstrom So in addition to mimicking a co-author with bad ideas, it can mimic a boss with no ideas who repackages your ideas as their own. The future is now!
@ct_bergstrom I tried one of your examples using your command and it thought it was fine. So no idea, unless you submitted a very long document (context window).
Also tried grammar correction on a New Yorker article for fun and it suggested a couple of very undesirable changes. Not impressed.
@ct_bergstrom I find it stunning that we’re trusting our creative work to the very same organization that had no scruples about swallowing all the IP on the internet.
I recognize that the self-attention layer of these models allows a level of recurrence, but I wonder if this failure to recognize that it's suggestions are identical to the original is in some way a symptom of the fact that these are basically feed-forward architectures.
@ct_bergstrom
On the other hand if your original is good enough, no need to change it for the sake of change (See Queen's Duck in Battle Chess). Your original good enough sentence will end up in the suggestion.
On a serious note, people that are top of their game will of course not have a use for ChatGPT because ChatGPT is human knowledge, not the best human knowledge, just a smart person.
Add comment