Talk:AutoGPT: Difference between revisions
→Self improvement: reply |
ChippyTechGH (talk | contribs) m ChippyTechGH moved page Talk:Auto-GPT to Talk:AutoGPT: It is now AutoGPT |
||
(23 intermediate revisions by 7 users not shown) | |||
Line 1: | Line 1: | ||
{{WikiProject banner shell|1= |
{{WikiProject banner shell|class=Start|1= |
||
{{WikiProject Artificial Intelligence}} |
{{WikiProject Artificial Intelligence}} |
||
{{WikiProject Computing |
{{WikiProject Computing |importance=Mid |software=y |software-importance=low |science=y |science-importance=low}} |
||
{{WikiProject Technology |
{{WikiProject Technology }} |
||
}} |
}} |
||
{{DYK talk|29 April|2023|entry=... that '''[[Auto-GPT]]''', an autonomous [[artificial intelligence|artificial-intelligence]] software agent, was used to create ChaosGPT, which has not yet achieved its goal of destroying humanity?|nompage=Template:Did you know nominations/Auto-GPT}} |
|||
==Did you know nomination== |
==Did you know nomination== |
||
Line 12: | Line 13: | ||
:I would go a bit further and state that at present there are no examples of it understanding or changing those 4000 lines of Python, and it can't in any meaningful way. Those files aren't available unless manually copied into its workspace. That is why I changed "rewrite" to "write". What is meant, and what the ''Toronto Sun'' headline and narrative in that and other sources actually mean, is that it can write, store, and reuse programs from scratch, and debug them when they don't work correctly. An example which works is "Write a program to print the first N prime numbers. Modify that program to only print odd prime numbers. Then use the modified program to print the first 20 odd primes." I agree we should add a sentence clarifying the meaning of "its own code" as not including the Auto-GPT base system or anything having to do with the GPT LLMs. [[User:Sandizer|<span style="font-family:Garamond;">'''''Sandizer'''''</span>]] ([[User talk:Sandizer|talk]]) 18:14, 17 April 2023 (UTC) |
:I would go a bit further and state that at present there are no examples of it understanding or changing those 4000 lines of Python, and it can't in any meaningful way. Those files aren't available unless manually copied into its workspace. That is why I changed "rewrite" to "write". What is meant, and what the ''Toronto Sun'' headline and narrative in that and other sources actually mean, is that it can write, store, and reuse programs from scratch, and debug them when they don't work correctly. An example which works is "Write a program to print the first N prime numbers. Modify that program to only print odd prime numbers. Then use the modified program to print the first 20 odd primes." I agree we should add a sentence clarifying the meaning of "its own code" as not including the Auto-GPT base system or anything having to do with the GPT LLMs. [[User:Sandizer|<span style="font-family:Garamond;">'''''Sandizer'''''</span>]] ([[User talk:Sandizer|talk]]) 18:14, 17 April 2023 (UTC) |
||
::I see the confusion now around the phrase "its own". At least the Toronto Sun article seems to mean "its own" as Auto-GPT itself: "Perhaps most significant, the program boasts the ability to rewrite and improve on its own code, allowing it to “recursively debug, develop and self-improve,” according to Significant Gravitas. How effective these '''self-updates''' are remains to be seen." (emphasis mine). At least that's how I read it. I'll take a crack at clarifying these distinctions later if you don't beat me to it. Thank you! [[User:StereoFolic|StereoFolic]] ([[User talk:StereoFolic|talk]]) 18:19, 17 April 2023 (UTC) |
::I see the confusion now around the phrase "its own". At least the Toronto Sun article seems to mean "its own" as Auto-GPT itself: "Perhaps most significant, the program boasts the ability to rewrite and improve on its own code, allowing it to “recursively debug, develop and self-improve,” according to Significant Gravitas. How effective these '''self-updates''' are remains to be seen." (emphasis mine). At least that's how I read it. I'll take a crack at clarifying these distinctions later if you don't beat me to it. Thank you! [[User:StereoFolic|StereoFolic]] ([[User talk:StereoFolic|talk]]) 18:19, 17 April 2023 (UTC) |
||
:::I added [https://en.wikipedia.org/enwiki/w/index.php?title=Auto-GPT&diff=prev&oldid=1150358212&diffmode=source this sentence] which is a bit clunky and certainly welcome any further improvements. I am not entirely sure that there are no examples so far of it submitting any pull requests to its own repository, but on the other hand I am sure that someone will eventually manage that as a worthy challenging exercise. I will try to see whether there are any such PRs so far and report back if I find them. |
:::I added [https://en.wikipedia.org/enwiki/w/index.php?title=Auto-GPT&diff=prev&oldid=1150358212&diffmode=source this sentence] which is a bit clunky and certainly welcome any further improvements. I am not entirely sure that there are no examples so far of it submitting any pull requests to its own repository, but on the other hand I am sure that someone will eventually manage that as a worthy challenging exercise. I will try to see whether there are any such PRs so far and report back if I find them. |
||
:::One side note which I think is the source of some of its issues, is that (some of?) the "short-term memory" statements in its database do get included in its context window, but as far as I can tell, the "long-term memory" files in the workspace aren't, so it's generally unaware of them unless references to them are in the "short-term" database or something causes to look at its workspace. I am not sure whether the file catalog of names (and descriptions?) is always in the context window, though, or what all can cause it to get observed. I wouldn't be surprised if it's generally nondeterministic, and is certainly very much in flux among the (hundreds of!) developers. [[User:Sandizer|<span style="font-family:Garamond;">'''''Sandizer'''''</span>]] ([[User talk:Sandizer|talk]]) 18:33, 17 April 2023 (UTC) |
|||
::::I can confidently say that it hasn't submitted any pull requests for anything yet, as [https://github.com/Significant-Gravitas/Auto-GPT/blob/master/autogpt/commands/git_operations.py it's git operations are limited to cloning repositories], at present. The [https://github.com/Significant-Gravitas/Auto-GPT/blob/master/autogpt/prompt.py prompt.py prompt generation routine] shows its basic capabilities, which for files are limited to its workspace that does not include its base system code. There do not seem to be any pending PRs which would add the ability to modify its base system or perform any kinds of writes or submit pull requests to repos. Having said that, who knows whether it can figure out how to use selenium to operate the GitHub web interface. And if anyone has copied its base system into its workspace and asked it to do anything with it including running it, I can't find any mention of that. [[User:Sandizer|<span style="font-family:Garamond;">'''''Sandizer'''''</span>]] ([[User talk:Sandizer|talk]]) 19:13, 17 April 2023 (UTC) |
|||
:::::I've [https://en.wikipedia.org/enwiki/w/index.php?title=Auto-GPT&diff=prev&oldid=1150498976&diffmode=visual taken a crack at rephrasing this] to simplify and clarify it, also moved to a separate paragraph since that was getting long. I don't think the details about its Github API abilities are necessary and seem to be original (though accurate) research. [[User:StereoFolic|StereoFolic]] ([[User talk:StereoFolic|talk]]) 14:54, 18 April 2023 (UTC) |
|||
::::::Looks good. I've moved on to [[LangChain]] and hope you might want to review that article. [[User:Sandizer|<span style="font-family:Garamond;">'''''Sandizer'''''</span>]] ([[User talk:Sandizer|talk]]) 15:20, 18 April 2023 (UTC) |
|||
==Persistent censorship== |
|||
Several IP edits have recently attempted to censor this page by removing references to ChaosGPT, apparently under the misguided idea that this knowledge is itself dangerous. It must be stressed that Wikipedia is [[WP:NOTCENSORED]]. I have requested increased protection for this page. [[User:StereoFolic|StereoFolic]] ([[User talk:StereoFolic|talk]]) 16:46, 27 April 2023 (UTC) |
|||
== Incorrect Sources and information == |
|||
I am a maintainer of auto-gpt. In an effort to meet wikipedia's contribution best practices, I cannot remove the incorrect information myself. |
|||
We do not support self improvement on the code base directly but it is in progress, and it has written several tests for the code base. You can read more about those efforts here: https://github.com/Significant-Gravitas/Auto-GPT/issues/15 |
|||
Additionally, AgentGPT is not based on Auto-GPT currently. A better example would be godmode.space. |
|||
[[User:Nick6787|Nick6787]] ([[User talk:Nick6787|talk]]) 07:21, 23 May 2023 (UTC) |
|||
:Thank you; [https://en.wikipedia.org/enwiki/w/index.php?title=Auto-GPT&diff=prev&oldid=1156556254 I've removed the incorrect AgentGPT association] as it was not backed by the cited sources. For now I've left the highly qualified bit about potential self improvement in place, as it is backed by sources. We can't use primary sources like GitHub issues. If you have a reliable secondary source expounding on the degree to which self-improvement is possible or expected to be possible, please let us know. [[User:StereoFolic|StereoFolic]] ([[User talk:StereoFolic|talk]]) 12:56, 23 May 2023 (UTC) |
|||
== Move page == |
|||
Please move page to [[AutoGPT]] as per [https://github.com/Significant-Gravitas/AutoGPT its repository] specified. [[User:ZanzibarSailor|ZanzibarSailor]] ([[User talk:ZanzibarSailor|talk]]) 16:25, 23 September 2023 (UTC) |
|||
:Yet [https://news.agpt.co/ the official website] has Auto-GPT. It seems like they use both names, the current situation (redirecting [[AutoGPT]] here) seems reasonable enough. [[User:StereoFolic|StereoFolic]] ([[User talk:StereoFolic|talk]]) 18:01, 23 September 2023 (UTC) |
|||
::Not a good a reason to say redirection seems reasonable enough. Brand is brand, not just a term problem. Anyway, let's wait a couple days for the change to come on their website. [[User:ZanzibarSailor|ZanzibarSailor]] ([[User talk:ZanzibarSailor|talk]]) 23:41, 23 September 2023 (UTC) |
|||
:::Oh, I see now [https://github.com/Significant-Gravitas/AutoGPT/pull/5301 they're officially in the process of migrating]. Yes, once it lands on the website let's move it. [[User:StereoFolic|StereoFolic]] ([[User talk:StereoFolic|talk]]) 00:37, 24 September 2023 (UTC) |
|||
==Wiki Education assignment: WRIT 340 for Engineers - Fall 2023 - 66816== |
|||
{{dashboard.wikiedu.org assignment | course = Wikipedia:Wiki_Ed/University_of_Southern_California_Viterbi_School_of_Engineering/WRIT_340_for_Engineers_-_Fall_2023_-_66816_(Fall_2023) | assignments = [[User:Irith-k|Irith-k]], [[User:Pourzand|Pourzand]], [[User:WikiLuvr9|WikiLuvr9]], [[User:Colinho99|Colinho99]] | start_date = 2023-08-21 | end_date = 2023-12-01 }} |
|||
<span class="wikied-assignment" style="font-size:85%;">— Assignment last updated by [[User:1namesake1|1namesake1]] ([[User talk:1namesake1|talk]]) 21:56, 23 October 2023 (UTC)</span> |
Latest revision as of 00:25, 23 September 2024
This article is rated Start-class on Wikipedia's content assessment scale. It is of interest to the following WikiProjects: | ||||||||||||||||||||||||||||||||||||||
|
A fact from AutoGPT appeared on Wikipedia's Main Page in the Did you know column on 29 April 2023 (check views). The text of the entry was as follows:
|
Did you know nomination
[edit]- The following is an archived discussion of the DYK nomination of the article below. Please do not modify this page. Subsequent comments should be made on the appropriate discussion page (such as this nomination's talk page, the article's talk page or Wikipedia talk:Did you know), unless there is consensus to re-open the discussion at this page. No further edits should be made to this page.
The result was: promoted by BorgQueen (talk) 02:10, 19 April 2023 (UTC)
- ... that Auto-GPT, an autonomous AI software agent, was used to create "ChaosGPT," which has not yet achieved its goal of destroying humanity? Source: Harrison, Maggie (2023-04-15). "AI Tasked With Destroying Humanity Now Trying New Tactic". Futurism: "ChaosGPT's first go at ending our species didn't quite work out."
- Reviewed:
Created by Sandizer (talk). Self-nominated at 21:06, 16 April 2023 (UTC). Post-promotion hook changes for this nom will be logged at Template talk:Did you know nominations/Auto-GPT; consider watching this nomination, if it is successful, until the hook appears on the Main Page.
- Currently reviewing this one... 28bytes (talk) 12:31, 17 April 2023 (UTC)
General: Article is new enough and long enough |
---|
Policy: Article is sourced, neutral, and free of copyright problems |
---|
|
Hook: Hook has been verified by provided inline citation |
---|
|
QPQ: None required. |
Self improvement
[edit]Sandizer - we've gone back and forth on this a couple times so maybe it's better to discuss here. I don't believe the sources support the unqualified claim that AutoGPT can meaningfully improve itself. If I'm missing something from the sources I apologize, though perhaps that warrants a more in-depth explanation with citations. My main concern with describing the self-improvement is that it can be misunderstood as suggesting AutoGPT is capable of a singularity-style self-improvement cycle. While I'm sure AutoGPT can non-trivially edit its Python harness code, it certainly cannot update the GPT model that provides all the seriously non-trivial power of the program. For context (I know this is original research), Auto-GPT is about 4000 lines of Python code, compared to presumably several terabytes behind the GPT model. Self-improvement to the python code is a very different thing than self-improvement to the model. StereoFolic (talk) 18:00, 17 April 2023 (UTC)
- I would go a bit further and state that at present there are no examples of it understanding or changing those 4000 lines of Python, and it can't in any meaningful way. Those files aren't available unless manually copied into its workspace. That is why I changed "rewrite" to "write". What is meant, and what the Toronto Sun headline and narrative in that and other sources actually mean, is that it can write, store, and reuse programs from scratch, and debug them when they don't work correctly. An example which works is "Write a program to print the first N prime numbers. Modify that program to only print odd prime numbers. Then use the modified program to print the first 20 odd primes." I agree we should add a sentence clarifying the meaning of "its own code" as not including the Auto-GPT base system or anything having to do with the GPT LLMs. Sandizer (talk) 18:14, 17 April 2023 (UTC)
- I see the confusion now around the phrase "its own". At least the Toronto Sun article seems to mean "its own" as Auto-GPT itself: "Perhaps most significant, the program boasts the ability to rewrite and improve on its own code, allowing it to “recursively debug, develop and self-improve,” according to Significant Gravitas. How effective these self-updates are remains to be seen." (emphasis mine). At least that's how I read it. I'll take a crack at clarifying these distinctions later if you don't beat me to it. Thank you! StereoFolic (talk) 18:19, 17 April 2023 (UTC)
- I added this sentence which is a bit clunky and certainly welcome any further improvements. I am not entirely sure that there are no examples so far of it submitting any pull requests to its own repository, but on the other hand I am sure that someone will eventually manage that as a worthy challenging exercise. I will try to see whether there are any such PRs so far and report back if I find them.
- One side note which I think is the source of some of its issues, is that (some of?) the "short-term memory" statements in its database do get included in its context window, but as far as I can tell, the "long-term memory" files in the workspace aren't, so it's generally unaware of them unless references to them are in the "short-term" database or something causes to look at its workspace. I am not sure whether the file catalog of names (and descriptions?) is always in the context window, though, or what all can cause it to get observed. I wouldn't be surprised if it's generally nondeterministic, and is certainly very much in flux among the (hundreds of!) developers. Sandizer (talk) 18:33, 17 April 2023 (UTC)
- I can confidently say that it hasn't submitted any pull requests for anything yet, as it's git operations are limited to cloning repositories, at present. The prompt.py prompt generation routine shows its basic capabilities, which for files are limited to its workspace that does not include its base system code. There do not seem to be any pending PRs which would add the ability to modify its base system or perform any kinds of writes or submit pull requests to repos. Having said that, who knows whether it can figure out how to use selenium to operate the GitHub web interface. And if anyone has copied its base system into its workspace and asked it to do anything with it including running it, I can't find any mention of that. Sandizer (talk) 19:13, 17 April 2023 (UTC)
- I've taken a crack at rephrasing this to simplify and clarify it, also moved to a separate paragraph since that was getting long. I don't think the details about its Github API abilities are necessary and seem to be original (though accurate) research. StereoFolic (talk) 14:54, 18 April 2023 (UTC)
- Looks good. I've moved on to LangChain and hope you might want to review that article. Sandizer (talk) 15:20, 18 April 2023 (UTC)
- I've taken a crack at rephrasing this to simplify and clarify it, also moved to a separate paragraph since that was getting long. I don't think the details about its Github API abilities are necessary and seem to be original (though accurate) research. StereoFolic (talk) 14:54, 18 April 2023 (UTC)
- I can confidently say that it hasn't submitted any pull requests for anything yet, as it's git operations are limited to cloning repositories, at present. The prompt.py prompt generation routine shows its basic capabilities, which for files are limited to its workspace that does not include its base system code. There do not seem to be any pending PRs which would add the ability to modify its base system or perform any kinds of writes or submit pull requests to repos. Having said that, who knows whether it can figure out how to use selenium to operate the GitHub web interface. And if anyone has copied its base system into its workspace and asked it to do anything with it including running it, I can't find any mention of that. Sandizer (talk) 19:13, 17 April 2023 (UTC)
- I see the confusion now around the phrase "its own". At least the Toronto Sun article seems to mean "its own" as Auto-GPT itself: "Perhaps most significant, the program boasts the ability to rewrite and improve on its own code, allowing it to “recursively debug, develop and self-improve,” according to Significant Gravitas. How effective these self-updates are remains to be seen." (emphasis mine). At least that's how I read it. I'll take a crack at clarifying these distinctions later if you don't beat me to it. Thank you! StereoFolic (talk) 18:19, 17 April 2023 (UTC)
Persistent censorship
[edit]Several IP edits have recently attempted to censor this page by removing references to ChaosGPT, apparently under the misguided idea that this knowledge is itself dangerous. It must be stressed that Wikipedia is WP:NOTCENSORED. I have requested increased protection for this page. StereoFolic (talk) 16:46, 27 April 2023 (UTC)
Incorrect Sources and information
[edit]I am a maintainer of auto-gpt. In an effort to meet wikipedia's contribution best practices, I cannot remove the incorrect information myself.
We do not support self improvement on the code base directly but it is in progress, and it has written several tests for the code base. You can read more about those efforts here: https://github.com/Significant-Gravitas/Auto-GPT/issues/15
Additionally, AgentGPT is not based on Auto-GPT currently. A better example would be godmode.space.
Nick6787 (talk) 07:21, 23 May 2023 (UTC)
- Thank you; I've removed the incorrect AgentGPT association as it was not backed by the cited sources. For now I've left the highly qualified bit about potential self improvement in place, as it is backed by sources. We can't use primary sources like GitHub issues. If you have a reliable secondary source expounding on the degree to which self-improvement is possible or expected to be possible, please let us know. StereoFolic (talk) 12:56, 23 May 2023 (UTC)
Move page
[edit]Please move page to AutoGPT as per its repository specified. ZanzibarSailor (talk) 16:25, 23 September 2023 (UTC)
- Yet the official website has Auto-GPT. It seems like they use both names, the current situation (redirecting AutoGPT here) seems reasonable enough. StereoFolic (talk) 18:01, 23 September 2023 (UTC)
- Not a good a reason to say redirection seems reasonable enough. Brand is brand, not just a term problem. Anyway, let's wait a couple days for the change to come on their website. ZanzibarSailor (talk) 23:41, 23 September 2023 (UTC)
- Oh, I see now they're officially in the process of migrating. Yes, once it lands on the website let's move it. StereoFolic (talk) 00:37, 24 September 2023 (UTC)
- Not a good a reason to say redirection seems reasonable enough. Brand is brand, not just a term problem. Anyway, let's wait a couple days for the change to come on their website. ZanzibarSailor (talk) 23:41, 23 September 2023 (UTC)
Wiki Education assignment: WRIT 340 for Engineers - Fall 2023 - 66816
[edit]This article was the subject of a Wiki Education Foundation-supported course assignment, between 21 August 2023 and 1 December 2023. Further details are available on the course page. Student editor(s): Irith-k, Pourzand, WikiLuvr9, Colinho99 (article contribs).
— Assignment last updated by 1namesake1 (talk) 21:56, 23 October 2023 (UTC)
- WikiProject Artificial Intelligence articles
- Start-Class Computing articles
- Mid-importance Computing articles
- Start-Class software articles
- Low-importance software articles
- Start-Class software articles of Low-importance
- All Software articles
- Start-Class Computer science articles
- Low-importance Computer science articles
- All Computing articles
- Start-Class Technology articles
- WikiProject Technology articles
- Wikipedia Did you know articles