NOTICE DATE: March 18, 2008
NOTICE TYPE: M-A031208-04 UPDATE - Outage/Retail Processing
CLASSIFICATION: Public
SHORT DESCRIPTION: ERCOT has determined that a subset of transactions
on March 12, 2008 was not processed through ERCOT systems.
INTENDED AUDIENCE: CRs and TDSPs
DAY AFFECTED: March 12, 2008
LONG DESCRIPTION: ERCOT has determined that the retail transaction
processing issues, which occurred on March 12, 2008, were the result of
human error. A slow-down on the application server was being
investigated and was believed to be a hardware issue. During the
investigation, the batch process was mistakenly restarted while one was
already running. This caused errors with the transaction processing and
corrupted log files.
Reason for delay in communication to the Market: The validity of the
exception queries that run against the logs was in question. The effort
continues to be a challenge due to the volume of data and the anomaly of
the problem that occurred with log files being corrupted or missing as a
result.
ADDITIONAL INFORMATION: Details on impacted transactions:
867s - ERCOT Initiated MarkeTrak issues were submitted to two (2) TDSPs
and ERCOT received the approval to reprocess (on March 18, 2008). ERCOT
has begun to reprocess and forward the 867s.
DUNS
Count
867s
1039940674000
10,008
867s
957877905
106,477
ERCOT will continue analysis to identify any additional 867 forwarding
delays.
814s - ERCOT is logging ERCOT Initiated MarkeTrak issues for 814s that
have been identified as not processing to request approval to reprocess.
The estimated count is ~ 150 transactions.
997s - ERCOT is reprocessing current missing 997s requests via MarkeTrak
issues and performing additional analysis for any potential impacts.
ERCOT Retail Account Manager's will provide all affected Market
Participant's with a list of impacted 867 transactions after 2:00 PM on
Wednesday, March 19, 2008. 814s will be communicated as ERCOT
initiated MarkeTrak issues.
CONTACT: If you have any questions, please contact your ERCOT Account
Manager. You may also call the general ERCOT Client Services phone
number at (512) 248-3900 or contact ERCOT Client Services via e-mail at
[log in to unmask]
If you are receiving e-mail from an ERCOT distribution list that you no
longer wish to receive, please follow this link in order to unsubscribe
from this list: http://lists.ercot.com <http://lists.ercot.com/> .
DP/TR
________________________________
From: ERCOT Client Relations
Sent: Monday, March 17, 2008 3:58 PM
To: [log in to unmask];
[log in to unmask];
[log in to unmask]
Cc: [log in to unmask]; [log in to unmask];
[log in to unmask]; 1 ERCOT Client Service Reps
Subject: M-A031208-03 UPDATE: Outage/Retail Processing
NOTICE DATE: March 17, 2008
NOTICE TYPE: M-A031208-03 UPDATE - Outage/Retail Processing
CLASSIFICATION: Public
SHORT DESCRIPTION: ERCOT experienced retail transaction processing
issues on March 12, 2008.
INTENDED AUDIENCE: CRs and TDSPs
DAY AFFECTED: March 12, 2008
LONG DESCRIPTION: ERCOT continues to analyze these processing issues to
determine the volume and transactions impacted. Additional information
will be provided as it becomes available.
CONTACT: If you have any questions, please contact your ERCOT Account
Manager. You may also call the general ERCOT Client Services phone
number at (512) 248-3900 or contact ERCOT Client Services via e-mail at
[log in to unmask]
If you are receiving e-mail from an ERCOT distribution list that you no
longer wish to receive, please follow this link in order to unsubscribe
from this list: http://lists.ercot.com <http://lists.ercot.com/> .
DP/JA
________________________________
From: ERCOT Client Relations
Sent: Friday, March 14, 2008 4:39 PM
To: [log in to unmask];
[log in to unmask];
[log in to unmask]
Cc: [log in to unmask]; [log in to unmask];
[log in to unmask]; 1 ERCOT Client Service Reps
Subject: M-A031208-02 UPDATE: Outage/Retail Processing
NOTICE DATE: March 14, 2008
NOTICE TYPE: M-A031208-02 UPDATE - Outage/Retail Processing
CLASSIFICATION: Public
SHORT DESCRIPTION: ERCOT experienced retail transaction processing
issues on March 12, 2008.
INTENDED AUDIENCE: CRs and TDSPs
DAY AFFECTED: March 12, 2008
LONG DESCRIPTION: ERCOT has discovered an issue processing a subset of
retail transactions as a result of the outage on Wednesday, March 12,
2008. ERCOT is currently analyzing these issues to determine the volume
and transactions impacted. Additional information will be provided as
it becomes available.
CONTACT: If you have any questions, please contact your ERCOT Account
Manager. You may also call the general ERCOT Client Services phone
number at (512) 248-3900 or contact ERCOT Client Services via e-mail at
[log in to unmask]
If you are receiving e-mail from an ERCOT distribution list that you no
longer wish to receive, please follow this link in order to unsubscribe
from this list: http://lists.ercot.com <http://lists.ercot.com/> .
DP/JA
________________________________
From: ERCOT Client Relations
Sent: Wednesday, March 12, 2008 10:57 AM
To: [log in to unmask];
[log in to unmask];
[log in to unmask]
Cc: [log in to unmask]; [log in to unmask];
[log in to unmask]; 1 ERCOT Client Service Reps
Subject: M-A031208-01 Outage - Retail/Wholesale
NOTICE DATE: March 12, 2008
NOTICE TYPE: M-A031208-01 Outage - Retail/Wholesale
CLASSIFICATION: Public
SHORT DESCRIPTION: This morning, ERCOT experienced issues with the
Customer Registration Application servers.
INTENDED AUDIENCE: CRs and TDSPs
DAY AFFECTED: Wednesday, March 12, 2008 from 9:08 AM to 10:15 AM
LONG DESCRIPTION: This morning, Wednesday, March 12, 2008 from 9:08 AM
to 10:15 AM ERCOT experienced an issue with the Customer Registration
Application servers. Impacts included Retail Transaction Processing,
Texas Market Link Query ESIID Transaction, eServices Disputes and
Service Requests, and MarkeTrak.
ERCOT's initial assessment has determined that the root cause is due to
a hardware failure. Additional details will be provided in the ERCOT IT
Incident Market Notice Summary.
CONTACT: If you have any questions, please contact your ERCOT Account
Manager. You may also call the general ERCOT Client Services phone
number at (512) 248-3900 or contact ERCOT Client Services via e-mail at
[log in to unmask]
If you are receiving e-mail from an ERCOT distribution list that you no
longer wish to receive, please follow this link in order to unsubscribe
from this list: http://lists.ercot.com <http://lists.ercot.com/> .
TR/JA
|