Globalyzer and ChatGPT: Difference between revisions
| (4 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
== ChatGPT Use in Globalyzer == | == ChatGPT Use in Globalyzer == | ||
Use ChatGPT either: | |||
* As a second pass once Globalyzer Scanning using Rules has identified candidate issues | |||
* Directly to scan for i18n issues | |||
== Globalyzer Rules Based Scanning + ChatGPT == | |||
In the Globalyzer Settings of each project locate "Apply ChatGPT prediction to Globalyzer reports" select "Yes". This will bring up a ChatGPT token form entry. | In the Globalyzer Settings of each project locate "Apply ChatGPT prediction to Globalyzer reports" select "Yes". This will bring up a ChatGPT token form entry. | ||
| Line 14: | Line 19: | ||
Once the Token has been added to the configuration, the next time a project analysis is performed there will be an automatic query to ChatGPT for every item identified as an issue by Globalyzer. This occurs post Globalyzer Scan and the run details are logged in the same way as a project run. It is important to note that the scan will only occur if a particular issue has not been previously scanned. This means that if an analysis is performed again immediately after an analysis run, only issues which are new or changed since the previous analysis will be sent to ChatGPT. This reduces the overall cost of incorporating ChatGPT into a Globalyzer environment. | Once the Token has been added to the configuration, the next time a project analysis is performed there will be an automatic query to ChatGPT for every item identified as an issue by Globalyzer. This occurs post Globalyzer Scan and the run details are logged in the same way as a project run. It is important to note that the scan will only occur if a particular issue has not been previously scanned. This means that if an analysis is performed again immediately after an analysis run, only issues which are new or changed since the previous analysis will be sent to ChatGPT. This reduces the overall cost of incorporating ChatGPT into a Globalyzer environment. | ||
=== Issues Page ChatGPT Indicators === | |||
Once an analysis has completed, opening up the Issues page will show there is a new icon being provided for each issue detected as highlighted below. This icon indicates the ChatGPT determined result for each issue as to whether ChatGPT identifies the issue as either: | Once an analysis has completed, opening up the Issues page will show there is a new icon being provided for each issue detected as highlighted below. This icon indicates the ChatGPT determined result for each issue as to whether ChatGPT identifies the issue as either: | ||
* True positive "Orange" | * True positive "Orange" | ||
| Line 21: | Line 26: | ||
[[File:IssuesChatgptIcons.png|1024px|center]] | [[File:IssuesChatgptIcons.png|1024px|center]] | ||
=== Issues Page Individual Issue ChatGPT Indicators === | |||
When expanding a single issue as shown below, in addition to the normally found items, there is an indicator for AI Prediction similar to what was shown prior to expanding the issue. Also, below the code snippet there is a new button "AI prediction reason". Selecting this button will send another request to ChatGPT asking for a more detailed explanation of why the line item was determined to be a true or false positive. Using this functionality will provide more information on what the determining factor was as additional time is taken by ChatGPT to analyze the reasoning. This can sometimes result in a change from true positive to false positive or the reverse. | When expanding a single issue as shown below, in addition to the normally found items, there is an indicator for AI Prediction similar to what was shown prior to expanding the issue. Also, below the code snippet there is a new button "AI prediction reason". Selecting this button will send another request to ChatGPT asking for a more detailed explanation of why the line item was determined to be a true or false positive. Using this functionality will provide more information on what the determining factor was as additional time is taken by ChatGPT to analyze the reasoning. This can sometimes result in a change from true positive to false positive or the reverse. | ||
| Line 27: | Line 32: | ||
[[File:IssuesAiPredictive.png|1024px|center]] | [[File:IssuesAiPredictive.png|1024px|center]] | ||
=== AI Prediction Reason === | |||
*Currently In Progress | *Currently In Progress | ||
=== Cost of Incorporation === | === Cost of Incorporation === | ||
| Line 38: | Line 45: | ||
{| border="1" class="wikitable" style="text-align:left; width=50%;" | {| border="1" class="wikitable" style="text-align:left; width=50%;" | ||
! Prediction Type !! Issues Checked !! Tokens Used !! Positive Issues !! Negative Issues !! Input Cost !! Output Cost !! Total Cost | ! Prediction Type !! Issues Checked !! Tokens Used !! Tokens/Issue !! Positive Issues !! Negative Issues !! Input Cost !! Output Cost !! Total Cost !! Cost/Issue | ||
|- | |- | ||
| AI Prediction || 96 || 5417 || 48 || 48 || $0.014 || $0.015 || $0.03 | | AI Prediction || 96 || 5417 || 56.43 || 48 || 48 || $0.014 || $0.015 || $0.03 || $0.003125 | ||
|- | |- | ||
| AI Prediction Reason|| TBD || TBD || TBD || TBD || TBD || TBD || TBD | | AI Prediction Reason|| TBD || TBD || TBD || TBD || TBD || TBD || TBD || TBD || TBD | ||
|} | |} | ||
== ChatGPT only Scanning == | |||
Globalyzer can also use ChatGPT directly without using the Globalyzer Scanning rules. The result will be reported in the same way as with Globalyzer Rules. However, the fine control that Globalyzer rules permits is not available with a direct ChatGPT scanning. | |||
The cost of scanning is directly dependent on the size of the source code. | |||
Latest revision as of 14:17, 9 April 2026
ChatGPT Use in Globalyzer
Use ChatGPT either:
- As a second pass once Globalyzer Scanning using Rules has identified candidate issues
- Directly to scan for i18n issues
Globalyzer Rules Based Scanning + ChatGPT
In the Globalyzer Settings of each project locate "Apply ChatGPT prediction to Globalyzer reports" select "Yes". This will bring up a ChatGPT token form entry.
- Copy your ChatGPT Token in this field.
- The ChatGPT token will start with "sk-" and is generally around 50 characters in length.
ChatGPT Functionality
Once the Token has been added to the configuration, the next time a project analysis is performed there will be an automatic query to ChatGPT for every item identified as an issue by Globalyzer. This occurs post Globalyzer Scan and the run details are logged in the same way as a project run. It is important to note that the scan will only occur if a particular issue has not been previously scanned. This means that if an analysis is performed again immediately after an analysis run, only issues which are new or changed since the previous analysis will be sent to ChatGPT. This reduces the overall cost of incorporating ChatGPT into a Globalyzer environment.
Issues Page ChatGPT Indicators
Once an analysis has completed, opening up the Issues page will show there is a new icon being provided for each issue detected as highlighted below. This icon indicates the ChatGPT determined result for each issue as to whether ChatGPT identifies the issue as either:
- True positive "Orange"
- False positive "Green".
Issues Page Individual Issue ChatGPT Indicators
When expanding a single issue as shown below, in addition to the normally found items, there is an indicator for AI Prediction similar to what was shown prior to expanding the issue. Also, below the code snippet there is a new button "AI prediction reason". Selecting this button will send another request to ChatGPT asking for a more detailed explanation of why the line item was determined to be a true or false positive. Using this functionality will provide more information on what the determining factor was as additional time is taken by ChatGPT to analyze the reasoning. This can sometimes result in a change from true positive to false positive or the reverse.
AI Prediction Reason
- Currently In Progress
Cost of Incorporation
Although it is impossible to be completely accurate regarding the costs of leveraging ChatGPT in Globalyzer, below are some real use data collecting that should prove useful. The Prediction Type of "AI Prediction" is the automated prediction that is obtained after each project analysis is performed. The AI Prediction Reason is the more in-depth query to determine the reasoning that a true positive or false positive was arrived at in the AI Prediction Scan.
- The below data was captured in October of 2025 for reference.
| Prediction Type | Issues Checked | Tokens Used | Tokens/Issue | Positive Issues | Negative Issues | Input Cost | Output Cost | Total Cost | Cost/Issue |
|---|---|---|---|---|---|---|---|---|---|
| AI Prediction | 96 | 5417 | 56.43 | 48 | 48 | $0.014 | $0.015 | $0.03 | $0.003125 |
| AI Prediction Reason | TBD | TBD | TBD | TBD | TBD | TBD | TBD | TBD | TBD |
ChatGPT only Scanning
Globalyzer can also use ChatGPT directly without using the Globalyzer Scanning rules. The result will be reported in the same way as with Globalyzer Rules. However, the fine control that Globalyzer rules permits is not available with a direct ChatGPT scanning.
The cost of scanning is directly dependent on the size of the source code.