NOTICE DATE: November 3,
2008
NOTICE TYPE: R-A103008-04 FINAL:
Retail Processing
SHORT DESCRIPTION: ERCOT experienced
an internal system processing issue Thursday, October 30, 2008, from 3:18 PM
through 9:31 PM. As a result, duplicated transactions or possibly
bad/invalid data was forwarded to Market Participants.
INTENDED AUDIENCE: CRs and TDSPs
DAY AFFECTED: Thursday, October
30, 2008 from 3:18 PM through 9:31 PM
LONG DESCRIPTION: ERCOT
experienced an internal system processing issue on October 30, 2008, from 3:18
PM through 9:31 PM. As a result, duplicated transactions or possibly
bad/invalid data was forwarded to Market Participants.
ERCOT
determined that there were 1,033,762 transactions in 71,270 files that were
sent out in error.
Root
Cause: ERCOT was in the process of setting up a separate disaster
recovery environment. The NAESB application was configured to function as
Production in the event of a disaster. At 3:18 PM on October 30, 2008,
the application was started in error which caused all test transactions in the
environment to be sent outbound to the market.
ADDITIONAL INFORMATION: On
Saturday, November 1, 2008, ERCOT provided MarkeTrak issue numbers to each
impacted Market Participant. The MarkeTrak issues contained transaction
level data on duplicate transactions or bad/invalid data for the appropriate
Market Participant.
CONTACT: If you have any questions, please
contact your ERCOT Account Manager. You may also call the general ERCOT Client
Services phone number at (512) 248-3900 or contact ERCOT Client Services via
e-mail at [log in to unmask].
If you are receiving e-mail from an ERCOT distribution list that
you no longer wish to receive, please follow this link in order to unsubscribe
from this list: http://lists.ercot.com.
DP/DH
From: ERCOT Client
Relations
Sent: Friday, October 31, 2008
2:49 PM
To:
[log in to unmask]; [log in to unmask];
[log in to unmask];
[log in to unmask];
[log in to unmask]
Cc: [log in to unmask];
[log in to unmask]; [log in to unmask]; 1 ERCOT Client Service Reps
Subject: R-A103008-03 UPDATE:
Retail Processing
NOTICE DATE: October 31,
2008
NOTICE TYPE: R-A103008-03
UPDATE: Retail Processing
SHORT DESCRIPTION: ERCOT experienced
an internal system processing issue Thursday, October 30, 2008, from 3:18 PM
through 9:31 PM. As a result, duplicated transactions or possibly
bad/invalid data was forwarded to several Market Participants.
INTENDED AUDIENCE: CRs and TDSPs
DAY AFFECTED: Thursday, October
30, 2008 from 3:18 PM through 9:31 PM
LONG DESCRIPTION: ERCOT
experienced an internal system processing issue on October 30, 2008, from 3:18
PM through 9:31 PM. As a result, duplicated transactions or possibly
bad/invalid data was forwarded to Market Participants.
Some of
these transactions may have contained a “TS Code” relating to a
Mass Transition.
There
is currently no Mass Transition taking place.
After
further analysis, ERCOT has determined that there were 1,033,762 transactions
in 71,270 files that were sent out in error.
ERCOT
has provided a spreadsheet to summarize the potential market impact. We
hope this will aid Market Participants with their clean-up efforts.
ERCOT
continues to perform the analysis to determine which transactions were
duplicated or invalid. Duplicates for the purposes of this analysis are
transactions that have the same ESIID, Original transaction number, and Tran
type as a transaction previously sent. The transaction ID may or may not
match the original transaction received. Invalid transactions are those
that either does not match a service order previously submitted, or match a
transaction previously submitted but the outbound response does not match what
occurred originally.
The
analysis is being worked based on the scenarios most likely to create
out-of-synch situations between ERCOT and the Market Participants. As the
analysis is completed, ERCOT will begin logging MarkeTrak issues. ERCOT
will provide additional information as it becomes available.
The
breakdown by transaction type is as follows:
Transaction Type |
Count |
814_02 |
6548 |
814_03 |
206856 |
814_05 |
113088 |
814_06 |
72460 |
814_08 |
67188 |
814_09 |
2633 |
814_11 |
7 |
814_12 |
324 |
814_13 |
1326 |
814_14 |
4 |
814_17 |
9829 |
814_18 |
7287 |
814_19 |
27183 |
814_20 |
22124 |
814_21 |
23862 |
814_22 |
4686 |
814_24 |
1628 |
814_25 |
14978 |
814_26 |
3 |
814_27 |
683 |
814_28 |
2128 |
814_29 |
24 |
824_02 |
2482 |
867FWD |
437264 |
997 |
9167 |
Total |
1033762 |
ADDITIONAL INFORMATION: The
attached spreadsheet details the potential transaction impact of the different
transactions involved.
ERCOT
will provide additional information as it becomes available.
CONTACT: If you have any questions, please
contact your ERCOT Account Manager. You may also call the general ERCOT Client
Services phone number at (512) 248-3900 or contact ERCOT Client Services via
e-mail at [log in to unmask].
If you are receiving e-mail from an ERCOT distribution list that
you no longer wish to receive, please follow this link in order to unsubscribe
from this list: http://lists.ercot.com.
JR/DH/DP
From: ERCOT
Client Relations
Sent: Friday, October 31, 2008
10:18 AM
To:
[log in to unmask]; [log in to unmask];
[log in to unmask];
[log in to unmask];
[log in to unmask]
Cc: [log in to unmask];
[log in to unmask]; [log in to unmask]; 1 ERCOT Client Service Reps
Subject: R-A103008-02 UPDATE:
Retail Processing
NOTICE DATE: October 31,
2008
NOTICE TYPE: R-A103008-02
UPDATE: Retail Processing
SHORT DESCRIPTION: ERCOT experienced
an internal system processing issue Thursday, October 30, 2008, from 3:18 PM
through 9:31 PM. As a result, duplicated transactions or possibly
bad/invalid data was forwarded to several Market Participants. Some of these
transactions may have erroneously contained a “TS Code” relating to
a Mass Transition.
INTENDED AUDIENCE: CRs and TDSPs
DAY AFFECTED: Thursday, October
30, 2008 from 3:18 PM through 9:31 PM
LONG DESCRIPTION: ERCOT experienced
an internal system processing issue on October 30, 2008, from 3:18 PM through
9:31 PM. As a result, duplicated transactions or possibly bad/invalid
data was forwarded to Market Participants.
ERCOT is currently working to identify the erroneous
transactions. MarkeTrak issues will be submitted to those MPs impacted
with the total volume counts and filenames of the invalid data. ERCOT
will follow up on these issues with transaction level detail of potential out
of sync conditions as soon as it is available to coordinate a resolution.
Additional information about this issue will be provided as it
becomes available.
ADDITIONAL INFORMATION: Some
of these transactions may have contained a “TS Code” relating to a
Mass Transition.
There is currently no Mass Transaction taking place.
CONTACT: If you have any questions, please
contact your ERCOT Account Manager. You may also call the general ERCOT Client
Services phone number at (512) 248-3900 or contact ERCOT Client Services via
e-mail at [log in to unmask].
If you are receiving e-mail from an ERCOT distribution list that
you no longer wish to receive, please follow this link in order to unsubscribe
from this list: http://lists.ercot.com.
DP/JR
From: ERCOT
Client Relations
Sent: Thursday, October 30, 2008
11:13 PM
To: [log in to unmask];
[log in to unmask];
[log in to unmask];
[log in to unmask];
[log in to unmask]
Cc: [log in to unmask];
[log in to unmask]; [log in to unmask]; 1 ERCOT Client Service Reps
Subject: R-A103008-01 Retail
Processing
NOTICE DATE:
October 30, 2008
NOTICE TYPE:
R-A103008-01 Retail Processing
SHORT DESCRIPTION:
Today, October 30, 2008, from 3:18 PM through 9:31 PM, ERCOT experienced
an internal system processing issue which sent duplicated transactions or
possibly bad/invalid data to Market Participants.
INTENDED AUDIENCE: CRs
and TDSPs
DAY AFFECTED:
Thursday, October 30, 2008 from 3:18 PM through 9:31 PM
LONG DESCRIPTION:
Today, October 30, 2008, from 3:18 PM through 9:31 PM, ERCOT experienced
an internal system processing issue which sent duplicated transactions or
possibly bad/invalid data to Market Participants.
ERCOT is currently working to identify
the erroneous transactions and corresponding Market Participants.
Additional information about this issue
will be provided as it becomes available.
ADDITIONAL INFORMATION:
Affected Market Participants will be provided lists when they become
available.
CONTACT: If
you have any questions, please contact your ERCOT Account Manager. You may also
call the general ERCOT Client Services phone number at (512) 248-3900 or
contact ERCOT Client Services via e-mail at [log in to unmask].
If you are receiving e-mail from an ERCOT
distribution list that you no longer wish to receive, please follow this link
in order to unsubscribe from this list: http://lists.ercot.com.
DP