NOTICE DATE: March 18, 2008 NOTICE TYPE: M-A031208-04 UPDATE - Outage/Retail Processing CLASSIFICATION: Public SHORT DESCRIPTION: ERCOT has determined that a subset of transactions on March 12, 2008 was not processed through ERCOT systems. INTENDED AUDIENCE: CRs and TDSPs DAY AFFECTED: March 12, 2008 LONG DESCRIPTION: ERCOT has determined that the retail transaction processing issues, which occurred on March 12, 2008, were the result of human error. A slow-down on the application server was being investigated and was believed to be a hardware issue. During the investigation, the batch process was mistakenly restarted while one was already running. This caused errors with the transaction processing and corrupted log files. Reason for delay in communication to the Market: The validity of the exception queries that run against the logs was in question. The effort continues to be a challenge due to the volume of data and the anomaly of the problem that occurred with log files being corrupted or missing as a result. ADDITIONAL INFORMATION: Details on impacted transactions: 867s - ERCOT Initiated MarkeTrak issues were submitted to two (2) TDSPs and ERCOT received the approval to reprocess (on March 18, 2008). ERCOT has begun to reprocess and forward the 867s. DUNS Count 867s 1039940674000 10,008 867s 957877905 106,477 ERCOT will continue analysis to identify any additional 867 forwarding delays. 814s - ERCOT is logging ERCOT Initiated MarkeTrak issues for 814s that have been identified as not processing to request approval to reprocess. The estimated count is ~ 150 transactions. 997s - ERCOT is reprocessing current missing 997s requests via MarkeTrak issues and performing additional analysis for any potential impacts. ERCOT Retail Account Manager's will provide all affected Market Participant's with a list of impacted 867 transactions after 2:00 PM on Wednesday, March 19, 2008. 814s will be communicated as ERCOT initiated MarkeTrak issues. CONTACT: If you have any questions, please contact your ERCOT Account Manager. You may also call the general ERCOT Client Services phone number at (512) 248-3900 or contact ERCOT Client Services via e-mail at [log in to unmask] If you are receiving e-mail from an ERCOT distribution list that you no longer wish to receive, please follow this link in order to unsubscribe from this list: http://lists.ercot.com <http://lists.ercot.com/> . DP/TR ________________________________ From: ERCOT Client Relations Sent: Monday, March 17, 2008 3:58 PM To: [log in to unmask]; [log in to unmask]; [log in to unmask] Cc: [log in to unmask]; [log in to unmask]; [log in to unmask]; 1 ERCOT Client Service Reps Subject: M-A031208-03 UPDATE: Outage/Retail Processing NOTICE DATE: March 17, 2008 NOTICE TYPE: M-A031208-03 UPDATE - Outage/Retail Processing CLASSIFICATION: Public SHORT DESCRIPTION: ERCOT experienced retail transaction processing issues on March 12, 2008. INTENDED AUDIENCE: CRs and TDSPs DAY AFFECTED: March 12, 2008 LONG DESCRIPTION: ERCOT continues to analyze these processing issues to determine the volume and transactions impacted. Additional information will be provided as it becomes available. CONTACT: If you have any questions, please contact your ERCOT Account Manager. You may also call the general ERCOT Client Services phone number at (512) 248-3900 or contact ERCOT Client Services via e-mail at [log in to unmask] If you are receiving e-mail from an ERCOT distribution list that you no longer wish to receive, please follow this link in order to unsubscribe from this list: http://lists.ercot.com <http://lists.ercot.com/> . DP/JA ________________________________ From: ERCOT Client Relations Sent: Friday, March 14, 2008 4:39 PM To: [log in to unmask]; [log in to unmask]; [log in to unmask] Cc: [log in to unmask]; [log in to unmask]; [log in to unmask]; 1 ERCOT Client Service Reps Subject: M-A031208-02 UPDATE: Outage/Retail Processing NOTICE DATE: March 14, 2008 NOTICE TYPE: M-A031208-02 UPDATE - Outage/Retail Processing CLASSIFICATION: Public SHORT DESCRIPTION: ERCOT experienced retail transaction processing issues on March 12, 2008. INTENDED AUDIENCE: CRs and TDSPs DAY AFFECTED: March 12, 2008 LONG DESCRIPTION: ERCOT has discovered an issue processing a subset of retail transactions as a result of the outage on Wednesday, March 12, 2008. ERCOT is currently analyzing these issues to determine the volume and transactions impacted. Additional information will be provided as it becomes available. CONTACT: If you have any questions, please contact your ERCOT Account Manager. You may also call the general ERCOT Client Services phone number at (512) 248-3900 or contact ERCOT Client Services via e-mail at [log in to unmask] If you are receiving e-mail from an ERCOT distribution list that you no longer wish to receive, please follow this link in order to unsubscribe from this list: http://lists.ercot.com <http://lists.ercot.com/> . DP/JA ________________________________ From: ERCOT Client Relations Sent: Wednesday, March 12, 2008 10:57 AM To: [log in to unmask]; [log in to unmask]; [log in to unmask] Cc: [log in to unmask]; [log in to unmask]; [log in to unmask]; 1 ERCOT Client Service Reps Subject: M-A031208-01 Outage - Retail/Wholesale NOTICE DATE: March 12, 2008 NOTICE TYPE: M-A031208-01 Outage - Retail/Wholesale CLASSIFICATION: Public SHORT DESCRIPTION: This morning, ERCOT experienced issues with the Customer Registration Application servers. INTENDED AUDIENCE: CRs and TDSPs DAY AFFECTED: Wednesday, March 12, 2008 from 9:08 AM to 10:15 AM LONG DESCRIPTION: This morning, Wednesday, March 12, 2008 from 9:08 AM to 10:15 AM ERCOT experienced an issue with the Customer Registration Application servers. Impacts included Retail Transaction Processing, Texas Market Link Query ESIID Transaction, eServices Disputes and Service Requests, and MarkeTrak. ERCOT's initial assessment has determined that the root cause is due to a hardware failure. Additional details will be provided in the ERCOT IT Incident Market Notice Summary. CONTACT: If you have any questions, please contact your ERCOT Account Manager. You may also call the general ERCOT Client Services phone number at (512) 248-3900 or contact ERCOT Client Services via e-mail at [log in to unmask] If you are receiving e-mail from an ERCOT distribution list that you no longer wish to receive, please follow this link in order to unsubscribe from this list: http://lists.ercot.com <http://lists.ercot.com/> . TR/JA