Debatching data is the process of turning one huge pile of data into many small piles of data. There are multiple tools for debatching large bulk data loads including BizTalk Server and SQL Server Integration Services (SSIS). One can use such tools to break up large batches of data, manipulate it as needed, and send it on to its next reincarnation (for example, into an API, a relational database, or a text file). In this article by Mike Sexton, co-author of Applied Architecture Patterns on the Microsoft Platform, we will take a look at options for processing large data sets and explain how to take giant sets of data and insert them into databases for analysis.Read Debatching Bulk Data on Microsoft Platform in full
The previous part of the article focused on just a few modules, with an emphasis on date. We explored Date formats, Exposed filters fieldset and the Views Date Range Filter Module. We also had a chance to create some summary views. In this part by Marjorie Roswell, we shall create a Timeline, cover the Views Popup feature, create a Calendar and also make an iCal feed.Read Date and Calendar Module in Drupal 5: Part 2 in full
This is the first part of a two-part article series by Marjorie Roswell. All of the recipes in this article require CCK and the date field (also Views, and Views UI), so we won't take the space to list them in every ingredient list. In this two-part article, we create a wide variety of views, mostly from a single workshop content type. Several of the views implement style plug-ins, which appear as new options in the Views Type drop-down. If you are still working on the 1.x versions of Date, be sure to check out Recipe 44, Upgrade Date and Calendar Modules which will be discussed in the next part.Read Date and Calendar Module in Drupal 5: Part 1 in full
Round-trip engineering as applied to a database means reverse engineering (database to data model) and forward engineering (data model to database) back and forth.
In this article, Djoni Darmawikarta shows how to maintain an existing MySQL database using Power*Architect. Particularly, he shows by examples, how to reverse engineer an existing MySQL database, update the resulting data model, compare the updated model with the 'old' database, and implement the updates by forward-engineering them back to the database.Read Database/Data Model Round-Trip Engineering with MySQL in full
In this article by Alexander Makarov, author of Yii Application Development Cookbook - Second Edition, we will cover the following topics:
- Getting data from a database
- Defining and using multiple DB connections
- Using scopes to get models for different languages
- Processing model fields with AR event-like methods
- Applying markdown and HTML
- Highlighting code with Yii
- Automating timestamps
- Setting up an author automatically
- Implementing single table inheritance
- Using CDbCriteria
There are three main methods to work with databases in Yii: Active Record, query builder, and direct SQL queries through DAO. All three are different in terms of syntax, features, and performance.
In this article we will learn how to work with the database efficiently, when to use models and when not to, how to work with multiple databases, how to automatically preprocess Active Record fields, and how to use powerful database criteria.
In this article we will use the Sakila sample database Version 0.8, available at the official MySQL website: http://dev.mysql.com/doc/index-other.html.Read Database, Active Record, and Model Tricks in full
Having seen form validation in the previous article, we will now cover database interaction. Databases are the backbone behind any Web application. Without a database, you'd have nowhere to hold all of your data, and SQL queries can become long and cumbersome to type out. Thankfully, CodeIgniter gives us a brilliantly simple way to interact with our Database. The database library also makes changing between database types—from MySQL to Oracle, for example—easier, because it acts as a wrapper and provides many functions for us to use on the database.
In this article by Adam Griffiths, author of CodeIgniter 1.7 Professional Development, you will:
- Perform database queries with the database library
- Return query results using the database helper functions
- Create queries using the active record library
- Learn how to cache active record queries
- Modify database tables using database forge
In this article, by Martin Brampton author of PHP 5 CMS Framework Development, we will cover the following topics about databases in PHP 5 Content Management Systems:
- Database dependency
- The role of the database
- Level of database abstraction
- Ease of development
- Keeping up with change
- Database security
- Pragmatic error handling
In this article, by Shaun Mitchell, author of SDL Game Development, we will explore a new way to create our states and objects by removing the need to hardcode the creation of our objects at compile time. To do this we will parse through an external file, in our case an XML file, which lists all of the objects needed for our state. This will make our states generic as they can be completely different simply by loading up an alternate XML file. Taking PlayState as an example, when creating a new level we would need to create a new state with different objects and set up objects we want for that level. If we could instead load the objects from an external file, we could reuse the same PlayState and simply load the correct file depending on the current level we want. Keeping classes generic like this and loading external data to determine their state is called Data-driven Design .
In this article we will cover:
Loading XML files using the TinyXML library
Creating a Distributed Factory
Loading objects dynamically using the factory and an XML file
Parsing a state from an XML file
Fitting everything together into the framework
Packt are due to launch a new Enterprise brand, into which future Silverlight titles will be published. For more information on that launch, look here.
In this article by Frank LaVigne, author of Microsoft Silverlight 4 Business Application Development, we shall:
- Bind the data from a data object to Silverlight controls
- Validate data and display feedback to the user
The secret of getting ahead is getting started. The secret of getting started is breaking your complex overwhelming tasks into small manageable tasks, and then starting on the first one—Mark Twain
In this article, we will cover the data types that you are most likely to use. We will also take an overview of the others. In addition, we will also cover field classes, which are where the special features are enabled.Read Data Types in Microsoft® Dynamics™ NAV in full
In this article by Kae Verens, we will look at:
- How to install and use the DataTables plugin
- How to load data pages on request from the server
- Searching and ordering the data
In this article by Traci L. Ruthkoski, the author of the book, Google Visualization API Essentials , we will discuss data sources for Charts. The integrated nature of Spreadsheets and Fusion Tables as data sources make the coding of Charts with these external data sources for the Visualization API quite straightforward.Read Data sources for the Charts in full
Data profiling is essentially data mining, but for a different purpose. You mine data to understand, to gain better knowledge about the data. While the more common use of data mining is for gaining the data insights for business purpose (e.g. customer buying characteristics), data profiling is for technical purpose. To be more precise, you do data profiling to gather and analyze the technical metadata characteristics of the data. Information Analyzer, data profiling software from IBM, helps you gain insight into such technical metadata characteristics as, for example, column data type and size (length).
This article is based on a case where a database table grew its size unexpectedly and its initial disk space allocation got strained. Looking at the growth pattern of the table, such as the number of new records (which was not that huge), didn’t give us any clue about the cause of the problem. In this article, Djoni Darmawikarta will step through the Information Analyzer process, run one of its functions called Column Analysis on a simple table (a scaled-down version of the real table), and show how the profiling output help solve the problem.Read Data Profiling with IBM Information Analyzer in full
SQL Server Integration Services, using its designer interface, or BIDS, has made it possible to process data using many of the data flow related items in its Toolbox without writing a line of code. This is a very attractive option for someone who is a beginner with some knowledge of databases, and for end users who may want to look up some detail buried in the data. This tutorial by Dr. Jayaram Krishnaswamy shows how the designed package extracts data from an SQL Server 2005 and processes it using several of its built-in transformations.Read Data Processing using Derived Column and Aggregate Data Transformations in full
"ERWin from Computer Associates (CA) is one of the most popular data modeling software in the market. I’ve been using this data modeling tool since its release 3; it’s now at release 7. In this article I’ll show how to create a data model from scratch, starting with logical and physical models, and then forward engineer the physical model to Oracle database". In this article by Djoni Darmawikarta we’ll create a data model for Sales Order, with customer and product data.Read Data Modeling with ERWin in full
Many data modelers recognize the advantages of standardizing the names of their modeling objects, particularly when they apply prime-class-modifier words pattern; but, they can’t afford its tedious manual execution.
InfoSphere Data Architect affords functions for building glossary of the standard pattern words that you can then employ while developing and maintaining your data models. This automation encourages the data modeler to apply naming standard to their modeling objects which in turn promotes consistency across their data models.
This article by Djoni Darmawikarta features the naming standard functionality in the glossary model of that IBM software.Read Data Modeling Naming Standards with IBM InfoSphere Data Architect in full
In this article by Amy Unruh, co-author of the book Google App Engine Java and GWT Application Development, we look at ways to structure and access your data objects to make your application faster and more scalable.Read Data Modeling and Scalability in Google App in full
In this article by Wolfgang Niefert, you will learn about the Advanced data migration tools, xFusion Studio in particular. You will also get to know a few tips and recommendations which you could use in your own project.Read Data Migration Scenarios in SAP Business ONE Application- part 2 in full
In this two-part article series by Wolfgang Niefert, you will be introduced to the tools and methods which will help you to migrate data from different sources into the SAP Business ONE application.Read Data Migration Scenarios in SAP Business ONE Application- part 1 in full
In this article by Gill Cleeren and Kevin Dockx, authors of Microsoft Silverlight 4 Data and Services Cookbook, we will learn about the following:
- Displaying data in a customized DataGrid
- Inserting, updating, and deleting data in a DataGrid
- Sorting and grouping data in a DataGrid