IS1024 Project Team 7

Вид материалаДокументы

Содержание


11. System Requirements
12. Licensing, Security, and Installation
13.1 Data and Technology Variations
13.1.2 Extraction, Transformation and Validation Rules
4.1 Prioritize Use Cases
Scope: BevDOT SystemLevel
Frequency of Occurrence
Frequency of Occurrence
Frequency of Occurrence
Scope: BevDOT Level
Подобный материал:
1   2   3   4   5

11. System Requirements

The hosting server will be a Windows based or Unix operating system with at least 4 GB of memory and each PC that interfaces with the sever must have at least 1 GB of memory in order to run the necessary queries. The hosting server will have at least 2 TB or storage with bays available to expand as needed.


12. Licensing, Security, and Installation

An Oracle or Microsoft licenses will be needed for the server. Microsoft licenses will be needed for the interfacing computers. Norton Antivirus software licenses will be needed for all computers in the network. Only authorized employees of Beverage Inc. will be allowed to access the system and updates will handled by the maintenance staff.


[Bryan DeFranco]
  1. Technical Specification



13.1 Data and Technology Variations


13.1.1 Data Chunk

A data chunk is a sufficient amount of data to perform batch validation, transformation, and storage in data warehouse for a DB-unit of information. This typically will be less than 12 records, or 100K Bytes per chunk, but each chunk will vary is size.


A DB-unit of information is that which sufficient to create a meaningful storage in Data Warehouse informational format. This is bound by the external rules file.


13.1.2 Extraction, Transformation and Validation Rules

Data extraction rules are specified outside of BevDOT, and define the data to retrieve. The rules file will also define table formats of Legacy system to facilitate ability to reconfigure if Legacy database structure changes in the future.

BevDOT

Legacy System

Validate

Transform


1. Introduction

Purpose

The purpose of this section was to prioritize the features and the use cases for the BevDot System and then identify the use cases for the first iteration. The prioritization of the use cases is related to the needs as specified in section two.


  1. 4.1 Prioritize Use Cases
    1. Features Table, Prioritized

ID

Feature

Effort

Risk

Comment

1

Extract Data

Med

High

Download data

2

Auto validate data

Med

High

Auto validation

3

Manually validate data

Med

High

Manual validation

4

Transform data to BevDOT

High

High

Transform data

5

Load data

Med

High

Load validated data

6

Error handling

High

High

Handle critical errors

7

Generate reports(high level)

Med

Med

High level reports

8

Generate ad-hoc reports

Med

Med

Ad-Hoc reports

9

Generate sales forecasting reports

Med

Med

Sales forecasting reports

10

Generate regional revenue reports

Med

Med

Regional revenue reports

11

Generate tracking reports

Med

Med

Tracking reports

12

Generate seasonal sales reports

Med

Med

Seasonal sales reports

13

Create system efficiency reports

Med

Low

System efficiency reports for IT

14

Create graphical representations of data

Med

Low

Make graphs based on report data



    1. Use Cases, Prioritized

The use cases have been derived from the features as shown above and put in order of importance from highest to lowest.
        1. ETL Use Case (Extract, Transform, Load)
        2. Automatic Validation
        3. Manual Validation
        4. Error Handling
        5. Generate Reports
        6. Generate Ad-Hoc Reports
        7. Create Graphs


  1. Section 4.2 Identify Use Cases for Initial Iteration

After discussing the necessary use cases for the successful operation of the system, the use cases have been narrowed down to six for the initial iteration of BevDOT. They are as follows:
  1. ETL Use Case
  2. Automatic Validation
  3. Manual Validation
  4. Error Handling
  5. Generate Reports
  6. Generate Ad-Hoc Reports

These six (6) use cases will fulfill the needs of the company in the initial iteration. Graphical representations of data from user-generated reports as well as additional reports will be added in future iterations.



























1. Introduction

Purpose

The purpose of this section is to further refine the system by finalizing preliminary use cases into fully dressed use cases. This section is to also refine the initial supplementary specification into the Final Supplementary Specification for the BevDOT data Warehouse.

5.1a (creator: Bryan Defranco)

Use Case #1.0


Use Case Name: Extract Data


Description: Initiates the ETL process for transferring data from the operational format legacy system to the informational format BevDOT data warehouse.


Scope: BevDOT System


Level: Batch Process


Primary Actor: Legacy System


Stakeholders and Interests: IT Department, DBA


Preconditions: BevDOT system has loaded the data acquisition and extraction rules from external file.


Success Guarantee (Postcondition): Required data is retrieved from Legacy System and passed to Validate Data1


Main Scenario (Basic Flow):
  1. BevDOT system connects to Legacy System using ODBC over TCP/IP
  2. Legacy System authenticates BevDOT system

3. BevDOT system generates SQL statements based on loaded rules, and the date the last extraction was performed.

4. BevDOT System submits query to Legacy System

5. Legacy system begins return of requested data

6. BevDOT System performs ValidateData1

7. BevDOT System checks if more data is available from Legacy system

8. BevDOT System disconnects from Legacy system


Extensions:

7a. Upon additional data available
  1. BevDOT restarts process at step 4.



7b. Upon no additional data available
  1. BevDOT resumes process at step 8



*a. Upon detection of system failure

1. BevDOT System performs Error Handling


Special Requirements: None


Technology and Data Variations: Data extraction rules are specified outside of BevDOT, and define the data to retrieve. The rules file will also define table formats of Legacy system to facilitate ability to reconfigure if Legacy database structure changes in the future.


Frequency of Occurrence: Weekly


5.1b (creator: Bryan Defranco)

Use Case #2.0


Use Case Name: Validate Data


Description: Ensures data integrity. Routes bad data to be held in temporary tables for Manual Validation


Scope: BevDOT System


Level: Sub Function


Primary Actor: Legacy System


Stakeholders and Interests: IT Department, DBA


Preconditions:

1. BevDOT System is authenticated with Legacy System

2. A data chunk has been extracted.

3. Validation rules have been loaded from external file.


Success Guarantee (Postcondition): Required data chunk is validated and passed to Transform Data


Main Scenario (Basic Flow):


  1. BevDOT System applies rules from external configuration.
  2. BevDOT System performs Transform Data



Extensions:

1a. Upon failure of validation algorithm
  1. BevDOT System saves the questionable data in temporary storage for manual review



*a. Upon detection of system failure

1. BevDOT System performs Error Handling
  1. Return error code to Extract Data



Special Requirements:

Validation rules will contain checks for null values, dates out of range, orphaned records, and any other items the DBA requires for successful transformation. This external configuration can be changed as needed.


Technology and Data Variations:

A data chunk is a sufficient amount of data to perform batch validation, transformation, and storage in data warehouse.


Frequency of Occurrence: As needed by parent process

5.1c (creator: Bryan Defranco)

Use Case #3.0


Use Case Name: Manual Validate Data


Description: DBA Corrects data anomalies received from Legacy Database


Scope: BevDOT System


Level: User Goal


Primary Actor: DBA


Stakeholders and Interests: IT Department, DBA


Preconditions:
  1. User is logged on to BevDBW system, and has entered Manual Validation screen
  2. Validation rules are loaded from external file



Success Guarantee (Postcondition): Data is successfully corrected and passed to Transform Data


Main Scenario (Basic Flow):


  1. BevDOT System displays questionable data from temporary storage
  2. User corrects data abnormalities
  3. BevDOT System validates data using validation rules
  4. BevDOT System performs Transform Data



Extensions:

3a. Upon failure of validation algorithm

1. BevDOT System displays data that did not pass validation
  1. BevDOT System resumes at step 1



*a. Upon detection of system failure

1. BevDOT System performs Error Handling


Technology and Data Variations: None


Special Requirements:

Validation rules will contain checks for null values, dates out of range, orphaned records, and any other items the DBA requires for successful transformation. This external configuration can be changed as needed.

5.1d (creator: Bryan Defranco)

Use Case #4.0


Use Case Name: Transform Data


Description: Data is cleansed and transformed from an operational format, into an informational format consistent with BevDOT data warehouse


Scope: BevDOT System


Level: Sub Function


Primary Actor: Legacy System


Stakeholders and Interests: IT Department, DBA


Preconditions:
  1. BevDOT System is authenticated with Legacy System
  2. A data chunk has been Extracted and Validated.
  3. Transformation Rules have been loaded from external file.



Success Guarantee (Postcondition): Required data chunk is cleansed and transformed and passed to Load Data


Main Scenario (Basic Flow):


  1. BevDOT System applies transformation algorithm to data.
  2. BevDOT System performs Load Data



Extensions:

*a. Upon detection of system failure:
  1. System displays error code
  2. System Performs Error Handling
  3. Return error code to Validate Data



Special Requirements: None


Technology and Data Variations:

A data chunk is a sufficient amount of data to perform batch validation, transformation, and storage in data warehouse.


Transformation algorithm is based on loaded rules defined external to the BevDOT system. These rules may be changed for future needs.


Frequency of Occurrence: As needed by parent process


5.1e (creator: Bryan Defranco)

Use Case #5.0


Use Case Name: Load Data


Description: Data is loaded into tables in the BevDOT data warehouse in a manner consistent with existing information data format


Scope: BevDOT System


Level: Sub Function


Primary Actor: Legacy System


Stakeholders and Interests: IT Department, DBA


Preconditions:

1. BevDOT System is authenticated with Legacy System

2. A data chunk has been Extracted, Validated, and Transformed.

3. BevDOT system has loaded the configuration rules from external file.


Success Guarantee (Postcondition): Required data is stored in data warehouse tables


Main Scenario (Basic Flow):
  1. BevDOT System generates SQL statements based on configuration file
  2. BevDOT System initiates transaction
  3. BevDOT System writes data to data warehouse tables using SQL
  4. BevDOT System commits changes



Extensions:

*a. Upon detection of system failure:
  1. System displays error code
  2. System Performs Error Handling



Special Requirements: None


Technology and Data Variations: Data Loading rules are specified outside of BevDOT. The rules file will define table formats of BevDOT system to facilitate ability to reconfigure if BevDOT database structure changes in the future.


Frequency of Occurrence: As needed by parent process


5.1f (creator: Mark Wimer)

Use Case #6.0


Use Case Name: Error Handling


Description: Error Handling use case will perform the appropriate actions if an abnormal error occurs within the system’s scope of performance.


Scope: BevDOT


Level: System Goal


Primary Actor: Database Administrator, System Administrator


Stakeholders and Interests: Senior Management, IT Department


Preconditions:
  1. BevDOT is performing a system function
  2. System error occurs



Success Guarantee (Postcondition):
  1. BevDOT successfully receives, codes, and logs system errors for later retrieval.



Main Scenario (Basic Flow):
  1. Legacy system sends handshake request to BevDOT
  2. BevDOT connects to Legacy System
  3. Legacy system sends error report(s) to BevDOT
  4. BevDOT disconnects from Legacy System
  5. BevDOT assigns incremental error code to each error report
  6. BevDOT logs errors in a flat file



Extensions (Alternative Flows):

6a. Export Error log
  1. User opens log file
  2. BevDOT displays all errors
  3. User chooses, ‘Export Data’ from file options
  4. BevDOT presents user with file extensions for exporting
  5. User selects file extensions and chooses, “Export”
  6. BevDOT creates export file.

6b. Delete Error Log
  1. User opens log file
  2. BevDOT displays all errors
  3. User chooses specific or all error logs
  4. User selects, ‘Delete’
  5. BevDOT displays warning prompt, “Are you sure?”
  6. User confirms ‘Delete’
  7. BevDOT removes selected error logs

*a. Upon detection of system failure:
  1. BevDOT halts process
  2. BevDOT dumps temporary memory to file
  3. BevDOT terminates process



Special Requirements: Error reports are stored until an IT user clears them from the BevDOT.


Technology and Data Variations: BevDOT retains a small portion of disk space for error logs.


Frequency of Occurrence: Daily or as needed.

5.1g (creator: David Azzolina; contributor(s): Mark Wimer )

Use Case # 7.0


Use Case Name: Generate Reports


Description: Serves as the initial reporting interface for users of the BevDOT system to generate reports based on existing BevDOT data.


Scope: BevDOT


Level: User Goal


Primary Actor: Sales, Marketing, Finance, Shipping, and IT departments.


Stakeholders and Interests: Sales, Marketing, Finance, Shipping, and IT departments – will use this to generate various reports for data contained within BevDOT.

Senior management - will use reports to set and track goals at the company, division, and country level to anticipate trends and changes in the market over time to improve forecasting, and to make executive decisions based on product demand.